📌 Change History - Forex Factory Data Scraper
← Back to Scraper
2025-08-27 Updates
Code Quality & Performance
- X94: Complete Production Cleanup - Removed all console.error statements, eliminated dead debugging code (26 lines of unused variables), removed unused cheerio dependency from package.json
- X93: Backend Error Handling - Replaced dummy test data return with proper error throwing to warn users when JSON extraction fails, removed 80+ lines of commented HTML parsing fallback code, cleaned all debug console.log statements from production
UI Polish & Consistency
- X91-92: Button Standardization - Fixed Clear All and Load Selected button dimensions to match (same width, height, padding), centered both buttons in container with consistent styling
Event Filtering & Search Improvements
- X84: Smooth Filtering - Major UX improvement with fixed filter bar outside table, preserving scroll position and input focus during filtering
- X78-83: Autocomplete System - Added smart autocomplete dropdown for event filtering with:
- Up to 10 matching suggestions with highlighting
- Fixed dropdown positioning and click detection
- Proper CSS overrides for consistent display
- Search button (🔍) and Enter key support
- X74-76: Event Filter UI - Added event filter input above Event column with live filtering, clear button, and "X of Y events" counter
- X85: Filter UI Polish - Moved search/clear buttons inline with purple/red color coding
File Management
- X88-89: Download Improvements
- Added timestamps to filenames (YYYY-MM-DD-HHmmss format)
- Changed from HH.mm.ss to cleaner HHmmss format
- Prevents file overwriting with unique names
UI Enhancements
- X86-87: Bulk Selection - Added "Check Visible" buttons for week/month selectors, removed redundant "Uncheck All" button
2025-08-25 Major Release
Core Functionality
- X45-46: Complete Timezone Fix - Eliminated all timezone processing issues:
- Times and dates kept exactly as ForexFactory provides
- Fixed day-off and hour-off problems
- Perfect match between website and table display
- X58-60: Enhanced Date Selection
- Enabled combined week+month selections (removed mutual exclusion)
- Fixed month boundary filtering for accurate date ranges
- Automatic deduplication of events
Data Enhancement
- X41-43: Event Classification
- Integrated EventTypes.csv lookup table
- Added Event Type columns to display and exports
- Created EventCrawler tool for comprehensive event mapping
- Added Day of Week column as first column
User Interface Redesign
- X24: Compact Layout Overhaul
- Side-by-side week/month selectors (always visible)
- Removed expandable popups
- Reduced font sizes by 2-3 points
- Optimized mobile responsive design
- X48-52: Event Detail Links
- Added clickable icons linking to ForexFactory event pages
- Popup windows (1440x900) with fallback to new tabs
- Integrated actual event URLs from backend
- X54-56: Visual Polish
- Enhanced table row hover effects with blue tinting
- Converted filter links to proper stacked buttons
- Improved click targets and visual hierarchy
Backend Optimization
- X29-31: Data Loading Fixes
- Fixed critical month loading issues (February, April, May)
- Resolved JSON extraction for large HTML responses
- Download buttons now export actual displayed data
- X23: Advanced Date Range System
- DateRangeManager class supporting 2007-2035
- Batch data loading with progress indicators
- Smart filter integration with ForexFactory codes
2025-08-24 Foundation Updates
Table & Display
- Implemented 200-row pagination with navigation controls
- Auto-expanding table layout without data cutoff
- Centered headers and prevented text wrapping
- Added functional "all/none" filter links
Project Structure
- Consolidated to single version (removed basic/detailed split)
- Separated JavaScript and CSS into external files
- Enhanced JSON extraction with brace counting algorithm
- Added dark-themed Event Filters panel
2025-08-23 Initial Release
Core Features
- Post-processing to fill missing times in event blocks
- Cache-busting timestamps on all fetch requests
- Fixed timezone offset issues (removed incorrect +1 hour)
- Improved date parsing using explicit ForexFactory headers
API & Backend
- Switched to Netlify Functions (removed Python scraper)
- Calendar selection returns exactly 7 days (date +6)
- Week quick-links with correct Monday calculation
- Rolling 7-day window from selected date
UI/UX
- Compacted manual scraping interface
- Aligned and stacked action buttons
- Fixed quick-links JavaScript errors
- Improved mobile spacing
- Added Change History page
Data Preview
- Shows all events (removed 20-item cap)
- Updated header and note information
- Streamlined layout with Data Preview below buttons
Repository & Documentation
- X62-72: Various updates to README, button consistency, API examples
- X57: Removed unnecessary 'Data' folder
- X59: Updated documentation for combined selections