DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Scraping Chinese Social Platforms for LLM Training Data: A Practical Multi-Source Pipeline (Python, 2026)
sami_8858131362756585e4f4 profile
Sami

Scraping Chinese Social Platforms for LLM Training Data: A Practical Multi-Source Pipeline (Python, 2026)

#python #webscraping #china #ai
Comments
7 min read
Requests vs curl_cffi vs Playwright: Which Network Stack Actually Fits Your Data Collection Workflow?
ellebanna profile

Requests vs curl_cffi vs Playwright: Which Network Stack Actually Fits Your Data Collection Workflow?

#webscraping #python #backend #devops
Comments
5 min read
When your web extraction tool should fail loudly instead of returning pretty lies
zee_builds profile
Zee

When your web extraction tool should fail loudly instead of returning pretty lies

#python #webscraping #ai #mcp
Comments
3 min read
What to do when websites change and your spider doesn't know
john_rooney profile

What to do when websites change and your spider doesn't know

#webscraping #zyte #data #programming
1
Comments
6 min read
Web Scraping in 2024: Whats Legal, Whats Not, and What Works
james12345000 profile
James

Web Scraping in 2024: Whats Legal, Whats Not, and What Works

#webscraping #legal #gdpr #ai
Comments
6 min read
How to Get Google, Bing, and Yandex Search Results as JSON
ning_2_f2dd40f720d6191e8 profile
elowen

How to Get Google, Bing, and Yandex Search Results as JSON

#webscraping #api #python #seo
Comments
2 min read
Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026
sami_8858131362756585e4f4 profile
Sami

Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

#python #webscraping #china #marketing
Comments
4 min read
How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML
ethan_thunderbit profile

How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

#ai #api #productivity #webscraping
Comments
7 min read
How to scrape Google Maps without code: a REST API tutorial
ilyas_yldrm_72e3216f68 profile

How to scrape Google Maps without code: a REST API tutorial

#api #google #tutorial #webscraping
Comments
5 min read
Rate Limits Are a Feature, Not a Bug
sian-agency profile

Rate Limits Are a Feature, Not a Bug

#api #architecture #softwareengineering #webscraping
Comments
4 min read
Find Jobs on Twitter: How I Built a Hiring Scraper
dan_kolb profile

Find Jobs on Twitter: How I Built a Hiring Scraper

#showdev #automation #career #webscraping
Comments
12 min read
How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)
joe_slade_2ffebf8d1164783 profile

How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)

#showdev #architecture #tooling #webscraping
Comments
4 min read
What Data Should You Store When Tracking Keyword Rankings?
florian_chen profile

What Data Should You Store When Tracking Keyword Rankings?

#seo #api #webscraping #data
Comments
2 min read
Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data
sami_8858131362756585e4f4 profile
Sami

Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data

#webscraping #python #ecommerce #china
Comments
3 min read
Building a Unified Korean Entertainment Database from 10 APIs and Web Scrapers
carasjung profile

Building a Unified Korean Entertainment Database from 10 APIs and Web Scrapers

#api #webscraping #korea #ai
2
Comments
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.