【发布时间】:2020-10-12 13:25:20
【问题描述】:
如何根据主题标签使用元数据(推文文本 - 用户 ID - 转推用户 ID)抓取推文?我正在尝试使用 tweepy api 代码:
import tweepy
import csv
import pandas as pd
####input your credentials here
consumer_key = ''
consumer_secret = ''
access_token = ''
access_token_secret = ''
auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth.set_access_token(access_token, access_token_secret)
api = tweepy.API(auth,wait_on_rate_limit=True)
#USA
# Open/Create a file to append data
csvFile = open('ua.csv', 'a')
#Use csv Writer
csvWriter = csv.writer(csvFile)
for tweet in tweepy.Cursor(api.search,q="#usa",count=100,
lang="en",
since="2018-04-03").items():
print (tweet.created_at, tweet.text)
csvWriter.writerow([tweet.created_at, tweet.text.encode('utf-8')])
【问题讨论】:
标签: python twitter scrapy tweepy scrape