scraping

3 posts
Mining Parler data

Just before the social network Parler went down, a researcher who goes by the Twitter username @donk_enby scraped 56.7 terabytes of data from the site via a less-than-secure API. Motherboard reports on what some researchers are doing with the data: One technologist took the scraped Parler data, took every file that had GPS coordinates included within it, formatted that information into JSON, and plotted those onto a map. The technologist...

0 0
Visualizing a Year of @realDonaldTrump

President Trump thumbed his way through another year in the White House while staying busy on Twitter, compiling a good (great) collection of 2,930 touts, complaints, defenses and rants. He left 2018 with this perplexing New Year’s Eve missive extolling the old-fashioned endurance of “Walls” and “Wheels” as one of his last. As the message shows, the president’s twitter presence lately is crowded by an increasingly evergreen list of grievances...

0 0
Practical tips for scraping data

It’s an unpleasant feeling when you have an idea for a project and the data you need is sitting right in front of you on a bunch of random-looking webpages instead of a nice, delimited file. You could either forget about your idea (which is what most people do), you can record manually, or you can take an automated route with a bit of scraping know-how. I often find myself...

0 0