Cython optimization

[zytegalaxy]

This pull request introduces a comprehensive Cython-based optimization and benchmarking framework for the python-redux project. It adds high-performance Cython implementations for core Redux components, extensive benchmarks for measuring performance improvements, and profiling tools to analyze bottlenecks. The changes also include updates to development dependencies and configuration files to support benchmarking and Cython compilation.

Cython Optimization and Benchmarking:

• Added a detailed CYTHON_README.md explaining the Cython optimization phases, benchmark results, and instructions for building and running benchmarks.
• Introduced new benchmark suites for dispatch, autorun, and combined reducers in the benchmarks/ directory, covering a variety of performance-critical scenarios. [1] [2] [3] [4]
• Added a profiling script profile_optimization.py to measure and analyze performance with heavy subscriber loads, using cProfile and pstats.

Cython and Benchmarking Support:

• Updated pyproject.toml to include cython and pytest-benchmark as development dependencies, and configured ruff and pyright to support the new benchmarks and Cython files. [1] [2] [3] [4]

Type Hints and Stubs:

• Added a .pyi type stub for redux/_combine_reducers.py to improve type checking and editor support for the Cython-optimized reducer logic.

Minor Cleanups:

• Simplified demo.py by removing unnecessary ruff disables.

These changes collectively provide a robust infrastructure for evaluating and leveraging Cython optimizations in python-redux, ensuring both high performance and maintainability.

[Copilot]

Pull request overview

This PR introduces Cython-based performance optimizations and a comprehensive benchmarking framework for the python-redux project. The changes refactor core components to support both pure Python and Cython implementations, add extensive performance benchmarks, and include profiling tools.

Key Changes:

• Added Cython-optimized implementations of Store and Autorun classes with a fallback mechanism to pure Python
• Introduced benchmark suites for measuring dispatch, autorun, and combined reducer performance
• Refactored code organization to separate pure Python implementations from Cython versions
• Updated development dependencies and configuration to support Cython compilation and benchmarking

Reviewed changes

Copilot reviewed 41 out of 52 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
redux/main.py	Refactored to conditionally import Cython or Python implementations of Store based on availability
redux/_store_py.py	New file containing the pure Python Store implementation (moved from main.py)
redux/_store_core.pyx	New Cython implementation of Store and Autorun classes for performance
redux/_store_core.pyi	Type stub file for the Cython Store implementation
redux/autorun.py	Refactored to conditionally import Cython or Python Autorun implementations
redux/_autorun_py.py	New file containing the pure Python Autorun implementation
redux/combine_reducers.py	Refactored to conditionally import Cython or Python combine_reducers
redux/_combine_reducers_py.py	New file containing the pure Python combine_reducers implementation
redux/_combine_reducers.pyx	New Cython implementation of combine_reducers
redux/_combine_reducers.pyi	Type stub file for the Cython combine_reducers
setup.py	New build configuration for Cython extensions
pyproject.toml	Added Cython and pytest-benchmark dependencies, updated linter and type checker configurations
benchmarks/bench_dispatch.py	New comprehensive benchmark suite for Store dispatch operations
profile_optimization.py	New profiling script for analyzing performance with heavy subscriber loads
tests/*.py	Updated ruff noqa directives and added compatibility fixes for Cython implementations
todo_demo.py, demo.py	Simplified ruff noqa directives

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

This hardcoded absolute path to Homebrew's Python site-packages is machine-specific and will not work on other systems. Consider removing this configuration or using a relative/environment-based path instead.

Suggested change

extraPaths = ["/opt/homebrew/lib/python3.11/site-packages"]

[Copilot]

The malloc and free imports from libc.stdlib are declared but never used in this file. Consider removing these unused imports.

Suggested change

from libc.stdlib cimport malloc, free

[Copilot]

The noqa comment # noqa: PLC0415 is duplicated. Remove the duplicate.

Suggested change

	from redux.autorun import Autorun # noqa: PLC0415 # noqa: PLC0415
	from redux.autorun import Autorun # noqa: PLC0415