RDRYUSLOG DEV

Browse by Topic

All 3599C# 756General 3Java 1072Python 1768

Popular

Popular Posts

Abstract illustration of a lock or seal representing the final keyword in Java, with a class, method, and variable symbol.
Java

Java Final Keyword: Usage and Behavior

Illustration of a Java final variable as a locked reference, with a single assignment arrow and a forbidden second assignment symbol.
Java

Java Final Variable: Syntax, Behavior, and Use Cases

Diagram contrasting explicit Dispose calls with garbage collector finalization timing in C#.
C#

C# Dispose vs Destructor: Key Differences Explained

Illustration of C# variable declaration showing type, name, and value assignment in a code editor.
C#

C# Variable Declaration: Syntax and Practical Usage

Latest

Latest Posts

Illustration of Scrapy middleware intercepting requests to manage cookies, proxy, and user agent.
Python

Python Scrapy Middleware for Cookies, Proxy, and User Agent

python scrapy middleware cookies proxy and user agent: Learn how to build Scrapy middleware to manage cookies, rotate user agents, and route requests through proxies,...

ScrapyMiddlewareWeb ScrapingProxy Rotation
Illustration of scraped data items flowing through a series of processing stages represented as connected pipeline nodes.
Python

Python Scrapy Items, Pipelines, and Data Processing

Learn how Scrapy item classes structure scraped data and how item pipelines validate, clean, deduplicate, and persist it before storage.

ScrapyWeb ScrapingData ProcessingItem Pipelines
Illustration of a Scrapy spider crawling through multiple paginated pages of a website.
Python

Python Scrapy Pagination and Multi-Page Crawling

Learn how to implement pagination in Python Scrapy to crawl multiple pages efficiently. Covers CrawlSpider rules, manual request loops, offset-based URLs, rate limiting, and error handling.

ScrapyWeb CrawlingPaginationCrawlSpider
Illustration of a Scrapy spider crawling between web pages with CSS and XPath selector brackets highlighting page elements.
Python

Python Scrapy: CSS, XPath, and Link Following

Learn how to select data with CSS and XPath in Scrapy and how to follow links with response.follow or CrawlSpider rules.

ScrapyWeb ScrapingCSS SelectorsXPath
A spider crawling a web page with request and response arrows and a selector extracting data.
Python

Python Scrapy Spider: Requests, Responses, and Selectors

Learn how Request, Response, and Selector objects work together in a Python Scrapy spider, from issuing requests to parsing pages with CSS and XPath.

ScrapyWeb ScrapingCSS SelectorsXPath
Comparison of Python Playwright and Selenium for browser automation, showing two browser windows with code snippets.
Python

Python Playwright vs Selenium: Which to Use?

Compare Python Playwright and Selenium for browser automation: installation, API design, selectors, waits, parallelism, browser support, and when to choose each.

PlaywrightSeleniumBrowser AutomationWeb Testing
Illustration of multiple browser pages being fetched concurrently by a Python Playwright async script
Python

How to Scrape Multiple Pages Concurrently with Python Playwright's Async API

Use Python Playwright's async API to scrape multiple pages concurrently. This article covers asyncio.gather, browser context isolation, concurrency limits, retries, and rate limiting.

PlaywrightAsyncWeb ScrapingConcurrency
A headless browser window connecting through a proxy server node to a target website, with a user agent tag, representing Playwright configuration in Python.
Python

Python Playwright Proxy, User Agent, and Headless Browser

Configure a Python Playwright browser with a proxy, custom user agent, and headless mode. Learn where each setting belongs, how to manage multiple proxy contexts, and how to debug common failures.

PlaywrightWeb ScrapingHeadless BrowserProxy Configuration
Illustration of a browser window with a network filter shield blocking unwanted requests while allowing essential traffic.
Python

Python Playwright Network Interception and Blocking Requests

python playwright network interception and blocking requests: Control network traffic in Python Playwright: intercept requests, block unwanted resources, and modify re...

PlaywrightPythonNetwork InterceptionRequest Blocking
Diagram showing a browser window with multiple tabs and an iframe panel, illustrating Python Playwright page and frame handling.
Python

Python Playwright: Iframes, Tabs, and Multiple Pages

Work with iframes, tabs, and multiple pages in Python Playwright using frame_locator, content_frame, expect_popup, expect_page, and context.pages.

Playwrightiframebrowser automationmulti-page