Struct ConcurrencyConfig 

pub struct ConcurrencyConfig { /* private fields */ }

Concurrency configuration with smart auto-detection

Provides intelligent defaults based on hardware capabilities:

• Auto-detection: Uses std::thread::available_parallelism() to detect CPU cores
• HDD-aware: Limits concurrency on systems with limited I/O
• Safe bounds: Clamps values between 1 and 16

Examples

use rust_scraper::ConcurrencyConfig;

// Auto-detect (default)
let config = ConcurrencyConfig::default();

// Explicit value
let config = ConcurrencyConfig::new(5);

// Get the resolved value
let concurrency = config.resolve();
println!("Using {} concurrent workers", concurrency);

Implementations

impl ConcurrencyConfig

pub fn new(value: usize) -> Self

Create a new config with explicit value

Arguments

• value - Explicit concurrency value (will be clamped 1-16)

Examples

use rust_scraper::ConcurrencyConfig;

let config = ConcurrencyConfig::new(5);
assert_eq!(config.resolve(), 5);

pub fn auto() -> Self

Create auto-detecting config (default)

Examples

use rust_scraper::ConcurrencyConfig;

let config = ConcurrencyConfig::auto();
let concurrency = config.resolve();
assert!(concurrency >= 1);

pub fn resolve(&self) -> usize

Resolve the actual concurrency value

Uses auto-detection based on CPU cores:

• 1-2 cores: 1 (avoid overwhelming system)
• 4 cores: 3 (HDD-aware default)
• 8+ cores: min(cores - 1, 8)

Returns

Concurrency value between 1 and 16

Examples

use rust_scraper::ConcurrencyConfig;

// Explicit value
let config = ConcurrencyConfig::new(5);
assert_eq!(config.resolve(), 5);

// Auto-detect
let config = ConcurrencyConfig::auto();
let value = config.resolve();
assert!(value >= 1 && value <= 16);

pub fn is_auto(&self) -> bool

Check if this config uses auto-detection

Examples

use rust_scraper::ConcurrencyConfig;

let auto = ConcurrencyConfig::auto();
assert!(auto.is_auto());

let explicit = ConcurrencyConfig::new(5);
assert!(!explicit.is_auto());

pub fn get(&self) -> Option<usize>

Get the raw value if explicitly set

Trait Implementations

impl Clone for ConcurrencyConfig

fn clone(&self) -> ConcurrencyConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ConcurrencyConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ConcurrencyConfig

fn default() -> Self

Returns the “default value” for a type.

impl Display for ConcurrencyConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<&str> for ConcurrencyConfig

Custom value parser for clap (accepts “auto” or number)

fn from(s: &str) -> Self

Converts to this type from the input type.

impl FromStr for ConcurrencyConfig

type Err = ParseIntError

The associated error which can be returned from parsing.

fn from_str(s: &str) -> Result<Self, Self::Err>

Parses a string s to return a value of this type.

impl ValueParserFactory for ConcurrencyConfig

type Parser = ConcurrencyValueParser

Generated parser, usually ValueParser.

fn value_parser() -> Self::Parser

Create the specified Self::Parser