Work Examples - WebScraping
What:
Read data from imdb and put it to an excel-sheet with specific informations. Get different informations
from the website itself and available imdb-modules
Used Modules:
selenium, bs4, xlwings, imdb, cinemagoer
What:
Get store-data from blizzard website with address, street, city, zip, etc.
Used Modules:
selenium, xlwings
What:
Collect data from amazon for asin, price, link, name, description
Used Modules:
selenium, xlwings, bs4
What:
Read informations from timeform.com for horseraces and put data to an excel-sheet, read complete
history for one year and update new entries
Used Modules:
selenium, bs4, xlwings
What:
Collect data from zalando like name, brand, price, links, partner-information
Used Modules:
selenium, bs4, xlwings
What:
Read actual ads on the platform and show in excel-sheet, update the infromation every few minutes
Used Modules:
selenium, bs4, xlwings
What:
Read actual restaurants from spain and povide email, adress, phone, etc. in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Scrape data from ebay-links like name, price, image, description
Used Modules:
selenium, bs4, xlwings
What:
Get store-data from atomic website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
What:
Check follower count from different tiktok-accounts in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read healthgrades.com and search for orthopedic surgery doctors in the US. Provide the data with address,
phone, email, reviews, specialities in an excel-sheet
Used Modules:
selenium, bs4, xlwings, vpn
What:
Get store-data from dynafit website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
What:
Scrape data from scansource for name, prodnumber, MFR, price description
Used Modules:
selenium, bs4, xlwings
What:
Search for workcodes, download the pdfs, merge them and store them
Used Modules:
selenium, bs4, pypdf2, xlwings
What:
Search for category and location, get informations about companies which provide this service with
address, email, phone, website. Executeable for windows.
Used Modules:
selenium, bs4, xlwings
What:
Collect data from douglas for prices, variants, labels, image, link, etc.
Used Modules:
selenium, bs4, xlwings
What:
Read searchwords and locations from excel and find jobs with salary-information on indeed.com
Used Modules:
selenium, bs4, xlwings
What:
Read links and search with them on ask.com, translate them from any language to english and store
the informatino in excel. Executeable for MacOs.
Used Modules:
requests, bs4, deep_translator, xlwings
What:
Get informatins from Developer Companies in the US Market and South America including all the reviews which are
available
Used Modules:
selenium, bs4, xlwings
What:
Check if an instragram-accontname is free
Used Modules:
selenium, bs4, xlwings
What:
Get store-data from Völkl website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
What:
Search for specific CEO-titles in Europe, and provide the informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read football-stats from israelian tournaments and provide data in an excel-sheet for games results and
standings for every round
Used Modules:
selenium, bs4, xlwings
What:
Collect data from a croatian bike-store and provide the documented solution in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read model-numbers for appliances and find the actual price and link for the product
Used Modules:
selenium, bs4, xlwings
What:
Read data from a website every hour, save the information to excel sheet and build history
Used Modules:
selenium, bs4, xlwings
What:
Read threads from a violinist forum and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read store-information for all locations with name, hours, description, name, phone, address
Used Modules:
requests, xlwings, api
What:
Collect the information for all stores and provide the data in an excel-sheet
Used Modules:
selenium, xlwings
What:
Read model-numbers for appliances and find the actual price and link for the product
Used Modules:
selenium, bs4, xlwings
What:
Collect machinery companies and their contact person, phone, address for different categories
Used Modules:
selenium, bs4, xlwings
What:
Collect data for companies with searchwords as input and find emails additonal.
Input will be the link to search - Output in excel
Used Modules:
selenium, bs4, xlwings, valueserp, emailfinder
What:
Collect data from a online gaming database with different informations about the titles and the development studios
Used Modules:
selenium, bs4, xlwings
What:
Get data from a Liquor Store for different cataegories with description, size, price and store locations with city, address, phone etc.
Used Modules:
selenium, bs4, xlwings
What:
Collect real estate data for a specific region and price range - return price, beds, batchrooms, heating, agent information, etc.
Used Modules:
selenium, bs4, xlwings, smartproxy
What:
Get name+company and find linkedin-profile with title
Used Modules:
requests, valueserp, xlwings
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read job-profiles on stepstone for a specific role and location - out the profile contace informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Create a list of of pathologists in switzerland
Used Modules:
selenium, bs4, xlwings
What:
Scrape data for a specific industry eg. Carpenters like address, phone, website
Used Modules:
selenium, bs4, xlwings
What:
Collect insolvencies from a website with different informations
Used Modules:
selenium, bs4, xlwings
What:
Read watch-prices from different countries and build the average price for every model
Used Modules:
selenium, bs4, xlwings
What:
Provide car informations for different brands with year and model description
Used Modules:
selenium, bs4, xlwings
What:
Read the shopping dealz from the website and update an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Collect text data from a website and put the scraped text in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Read all listed jobs for a specific searchstring and provide all the data including a optional detailed description in excel
Used Modules:
selenium, bs4, xlwings
What:
Check car bids from finished auctions and update the information in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Scrape data for reward credit cards informations like bonuses, annual fees, cashback and other benefits
Used Modules:
selenium, bs4, xlwings
What:
Search for schools in colorado for a specfic area an provide some info like address, email, phone in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Collect camping places in germany with data like address, places, energy, dogs allowed, wlan, etc.
Used Modules:
selenium, bs4, xlwings
What:
Collect data from the realtor website for a specific area and provide data like address, price, beds,
baths, sqfts, etc.
Used Modules:
selenium, bs4, xlwings, scrapeops API
What:
Read data from audible and check the rating informations for the different audiobooks and and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Get stockdata from nseindia with price, buy quantity, sell quantity
Used Modules:
selenium, bs4, xlwings
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Collect football statistics from previous games, teams, results, goals, etc.
Used Modules:
selenium, bs4, xlwings
What:
Collect parking informations all over the world
Used Modules:
selenium, bs4, xlwings
What:
Read and store all images from a real estatet posting on trulia.com
Used Modules:
selenium requests, bs4, xlwings
What:
Collect data for a specific postcode for renting working equipment and vehicles
Used Modules:
selenium, bs4, xlwings, undetected chromedriver
What:
Scrape data from betting portal for football-season and different quotes
Used Modules:
selenium, bs4, xlwings
What:
Collect data for paying providers with different infos like cards and countries
Used Modules:
selenium, bs4, xlwings
What:
Scrape data for doctors like email, name, address, website, specialization
Used Modules:
selenium, bs4, xlwings
What:
Read coin-information and buidl a historical comparison for price, marketcap, etc.
Used Modules:
selenium, bs4, xlwings
What:
Collect data from the AI-directory for name, website, price, descrition, labels, etc.
Used Modules:
selenium, bs4, xlwings
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
What:
Get data from profishop like title, image, description, article-number, technical details
Used Modules:
selenium, bs4, xlwings
What:
Get data for the shops from ringschuh with address, email, website, phone, etc.
Used Modules:
selenium, bs4, xlwings
What:
Get data for properties in Malaysia with locatoin, price, beds, baths, parking, images, etc.
Used Modules:
selenium, bs4, xlwings
What:
Get business from south africa from the yellow page with name, location,
website, emails, etc.
Used Modules:
selenium, bs4, xlwings
What:
Read data for a twitter-search with name, profileimage, link, text, etc.
Used Modules:
selenium, bs4, xlwings
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
What:
Collect data from real estate projects in Saudi Arabia with overview, amenities, payment plans,
location maps, master plans, floor plans, images galleries, etc.
Used Modules:
selenium, bs4, xlwings
What:
Check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
What:
Provide all products which have discounts on Amazon for a specific link and
provide price, old-price, discount
Used Modules:
selenium, bs4, xlwings
What:
Check prices for all possible combinations of an ebay-add with link, price,
combination
Used Modules:
selenium, bs4, csv
What:
Collect games wishlist-data with name, followers, release date, developer,
images, description, etc.
Used Modules:
octoparse
What:
Scrape player data for different esport-gams with playername, age, team, country, twitter, instagram, etc.
images, description, etc.
Used Modules:
selenium, bs4, csv
What:
Collect data from video-lessons with book, author, edition, chapter, question, etc.
Used Modules:
selenium, bs4, xlwings
What:
Read and download flyers and store every page of the flyer as an image to a mysql-db
Used Modules:
selenium, bs4, xlwings, requests, mysql
What:
Read informations from timeform.com for greyhound races and provide the detailed data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
What:
Collect reviews from specific products on the Spain Amazon website with there asin-number and provide
the data in an excel-sheet
Used Modules:
selenium, xlwings, rainforest-api
What:
Scrape data for australian horse-races in the actual year and provide the data in an excel-sheet like horse,
jockey, trainer, odds, race, distance, location, etc.
Used Modules:
selenium, xlwings, bs4
What:
Check the election contributions for different persons and provide the detailed
informaton in an excel-sheet
Used Modules:
selenium, xlwings, bs4
What:
Read financial data from stocks from balance sheet, cash flow statement
using a rotating proxy solution
Used Modules:
selenium, xlwings, bs4, buyproxies