Tags » Python

Scrapy | A Fast and Powerful Scraping and Web Crawling Framework

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

via Scrapy | A Fast and Powerful Scraping and Web Crawling Framework.

Academic Technology

Web Scraping 101 with Python

Now that we have the packages we need, we can start scraping. But first, a couple of rules.

You should check a site’s terms and conditions before you scrape them. 91 more words

Academic Technology

Historic Bus Location Data

Last night I was trying to think of interesting uses for a Rasberry Pi. One thing I came up with was a data logger. But what to log? 865 more words


IPs and Ports - taming the Pyhton vol 2 [work in progress here]

well.. it’s another week in school, and the homework for this week is to write a script that asks the “user” for an IP adress and port number and then makes a signature inquiry and (if successful) outputs the signature. 414 more words


Highest Demand Programming Languages in March 2015

A question that I hear frequently is: “Which programming language (or languages) should I learn? Usually the person asking is a student and what they really mean is, “What programming language will get me a job?!” My usual answer is that it’s more important to focus on learning concepts (like: inheritance, composition, polymorphism, data structures, design patterns, etc.) because these are pretty much the same regardless of language. 433 more words


How to read the content of a website with python

For this example code I used a timeout, checked the status code and used json if possible.

After some reading, about what libraries to use when it comes to reading content from websites, I wanted to try pythons… 743 more words


MIT 6.00SC | Lecture 13 | Some Basic Probability and Plotting Data


In the last lecture, we had a error in our code, because the Random walk code, did not output correct value of small samples as we had manually checked. 1,006 more words