Spider – Six Word Story #4

This is in response to ‘The Saturday Six Word Story Prompt’ by Shweta of ‘My Random Ramblings’.

The prompt for this week is ‘Spider’, and here is my take on it. I’ve interpreted spider as a web crawler.

——– SPIDER ——–

Python lets the Scrapy Spider crawl.


To non-coders, let me explain the terms used here.

Python is a general purpose programming language.

Web Crawler is a computer program which browses the World Wide Web in a methodical, automated manner. It is also called a web robot or web spider, and this process is called web crawling or ‘spidering’.

Scrapy is an open-source web-crawling framework, written in Python.

Spider, in general, is a program that fetches web pages, and is used for crawling and indexing entries in search engines. With respect to Scrapy, Spider is a class (an extensible program code template) responsible for defining how to follow the links through a website and extract information from the pages.


Logo of the_saturday_six_word_story_prompt

To know more about the prompt, go through the guidelines and the prompts & round-up posts, on her blog.

Picture Courtesy: Featured Image by Google Images.

35 Comments Add yours

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s