Skip to content

tomasd1/flats

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

flats-scraper

Simplistic (no synching, simply starts afresh each time) web scraper. Scrapes data about available flats into MongoDB - example for BytyRoudna website.

todo: more validations, logging

Scrapy & MongoDB & pydantic

Spider for BytyRoudna can be launched from command line as follows:

scrapy crawl -s MONGODB_URI="<>" -s MONGODB_DATABASE="db_name" bytyroudna

About

Simplistic web scraper.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages