English | MP4 | AVC 1920×1080 | AAC 44KHz 2ch | 53 Lessons (10h 33m) | 4.01 GB
Master the art of extracting data from the web
I’ve made a living for 3+ years from just web scraping, made over $125k, have 25k+ social media followers, and in this course I’m going to reveal exactly how I scrape sites, and how to get clients/grow on social media.
Here’s what you’ll get:
In the course I show you how to scrape these sites (and give you the code):
- Tiktok
- Zillow
- Google Search
- Google Maps
- Amazon
- Indeed
- ESPN
- Angi List
- And more!
I’ll also show you how I have gotten clients, and how I’ve gotten my 25k+ followers on social media (and how you can too)
What’s Inside:
- 9 hours of videos
- Is web scraping legal?
- Scrapers vs Hackers
- All the services I use (proxies, coding language, servers, database, packages to get around getting blocked)
- How websites get their data (how API’s work)
- My process for scraping ANY site
- How to find where data is coming from
- How to avoid getting blocked
- All about proxies
- Scraping by web framework (React, Next.js, static HTML/server rendered, ASP.NET, Java)
- How to reverse engineer sites with good blocking
- Scraping sites with Cursor Based Pagination (YouTube comments)
- Scraping a chrome extension for free emails
- How to scrape mobile apps
- How to skip trace (find random people’s phone numbers and emails)
- How to get Puppeteer running on AWS Lambda
- How to intercept requests with Puppeteer
- Solving captchas with Puppeteer
- How to get web scraping clients
- How to charge clients
- Product ideas that rely on web scraping
Table of Contents
1 The Ultimate Web Scraping Course
2 Legality of web scraping
3 Scraping vs Hacking
4 Services we’ll be using in the course
5 Services we’ll be using in the course 2
6 How websites get their data
7 My process for Scraping Any Site
8 How to find where the data is coming from
9 Proxies
10 Scraping Next.js sites (angi, imdb)
11 ESPN – Scraping API’s
12 Amazon – Straight up HTML page
13 Update on Overcoming CloudFlare Blocks
14 Indeed – Straight Up HTML
15 Sarpy – ASP.NET (long version)
16 Sarpy – ASP.NET Cliff Notes
17 Kitsap – Java Site
18 Google Maps
19 Linkedin
20 How to scrape Shopify
21 They can’t hide anything from you….
22 Reverse Engineering Realtor API
23 Lynchburg exposing Auth Token
24 Beacons.ai
25 Twitter
26 Instagram Scraping Update
27 How to Scrape Instagram Profiles
28 Instagram
29 Arcgis
30 Cursor Based Pagination
31 Scraping Mobile Apps
32 Scraping Zillow Data Tutorial
33 Skip Tracing
34 Getting Puppeteer Up and Running on AWS Lambda
35 facbleag
36 Getting Tiktok Videos with Puppeteer
37 Solving CAPTCHAs with Puppeteer
38 Sitemaps (crunchbase)
39 Update 12312024 Use puppeteer to get company pages
40 Google Tricks and Tips
41 Decoding Imperva Security Measures
42 Leveraging Google’s Web Cache to get around Cloudflare and Datadome blocking
43 Scraping Kick (got-scraping + use your resources)
44 I found a way to scrape Ohio State Student Emails
45 Tiktok API
46 SC Courts, use undetected chrome driver
47 Exploring Supabase for Efficient Database Management
48 Where to host the scrapers_ Render.com
49 Quick note on Concurrency in Web Scraping
50 How to make money web scraping
51 How to get web scraping clients
52 What do you charge clients
53 What should you scrape for
Resolve the captcha to access the links!