William Peidong Gao

William Peidong Gao

Ph.D. candidate in Genetics at Case Western Reserve University. I work on bioinformatics, multi-omics, human islet biology, and diabetes.

WillGaoLab

Daily Market Tracker

Published:

Daily Market Tracker is an automated market observation system for recording the opening state of nine financial indicators across equities, risk and sentiment, and macro conditions.

For eight traditional market instruments, it records the previous Yahoo Finance daily close, current daily open, absolute gap, and gap percentage. Because Bitcoin trades continuously, the tracker instead compares its latest 00:00 UTC daily open with the current market price available when the data is collected.

Those observations are stored in one historical CSV, used to generate a daily Overnight Market Fingerprint, and presented through a public Streamlit dashboard. The project is designed to observe market conditions consistently over time; it does not predict market direction or provide trading recommendations.

Open the live dashboard View the latest fingerprint

What’s New in Version 2.0

Version 2.0 expands the original six-indicator tracker with the Dow Jones Industrial Average, Gold Futures, and Bitcoin. The nine indicators are organized into three complementary groups:

  • Equities: S&P 500, Nasdaq-100 Futures, and Dow Jones Industrial Average
  • Risk & Sentiment: VIX, Bitcoin, and Gold Futures
  • Macro: U.S. 10-Year Treasury Yield, U.S. Dollar Index, and WTI Crude Oil

The expanded Market Fingerprint combines a radar chart and heatmap so the nine overnight observations can be read together. VIX and the U.S. dollar are direction-adjusted in the visualization to keep the color and shape language consistent; labels continue to show the raw percentage changes.

Version 2.0 also migrates the history schema in place. It preserves the original records, marks Bitcoin values that cannot be reconstructed as NA, and records the complete schema for every new automated observation.

Daily Workflow

On each U.S. trading day after the market close, GitHub Actions:

  1. Runs the automated test suite.
  2. Retrieves Yahoo Finance data for all nine indicators.
  3. Validates and appends one record to data/history.csv.
  4. Generates figures/YYYY-MM-DD.png from the historical record.
  5. Commits the new data and figure when a valid new day is available.

The scheduled workflow runs on weekdays at 22:15 UTC, after the U.S. cash close in both Eastern Standard and Daylight Time. The pipeline is idempotent: an existing date is not duplicated. Weekends and regular NYSE holidays are skipped, while missing data on an expected trading day fails visibly instead of being silently treated as a holiday.

Use Locally

Clone the repository and install its dependencies:

git clone https://github.com/WillGaoLab/Daily_Market_Tracker.git
cd Daily_Market_Tracker
python3 -m venv .venv
source .venv/bin/activate
python -m pip install -r requirements.txt

Fetch a current-day preview without changing the history file:

python scripts/fetch_data.py

Run the complete idempotent pipeline and launch the dashboard:

python scripts/daily_pipeline.py
streamlit run app.py

To backfill a missing U.S. trading day or regenerate an existing fingerprint:

python scripts/daily_pipeline.py --date YYYY-MM-DD
python scripts/generate_fingerprint.py --date YYYY-MM-DD

Data and Methodology

data/history.csv is the project’s single source of truth. Market Fingerprint figures, the public fingerprint page, and the Streamlit dashboard are derived from that file.

The tracked Yahoo Finance symbols are ^GSPC, NQ=F, ^DJI, ^VIX, BTC-USD, GC=F, ^TNX, DX-Y.NYB, and CL=F. Traditional instruments use the previous close and current daily open. Bitcoin uses its latest 00:00 UTC daily open and the current price at collection time; a manual backfill cannot reconstruct a historical intraday Bitcoin price.

The migrated history preserves its original July 15, 2026 manual seed and July 16 automated record. Later rows are collected automatically. Historical values represent the observation available at collection time and are not automatically rewritten.

Yahoo Finance data can be delayed, revised, or unavailable. Users are responsible for complying with Yahoo Finance terms of use, exchange data rules, and applicable law before using or redistributing generated data.

Privacy and Scope

The hosted Streamlit dashboard uses Google Analytics 4 and Microsoft Clarity to process usage and technical analytics data under their respective terms and privacy policies.

Daily Market Tracker is an observation and learning tool. It does not predict markets, execute trades, or provide investment, financial, tax, legal, or trading advice.

Attribution and Affiliation

Daily Market Tracker is an independent open-source project developed and maintained by William Peidong Gao under WillGaoLab.

This project is not affiliated with, endorsed by, sponsored by, or officially associated with Yahoo, Yahoo Finance, Nasdaq, NYSE, Cboe, CME Group, ICE, any exchange, index provider, or other organization referenced here.

All trademarks, service marks, ticker symbols, company names, exchange names, and data-provider names are the property of their respective owners and are used solely for identification and descriptive purposes.

License

Original code and documentation are released under the MIT License © 2026 William Peidong Gao. The MIT grant covers this project’s own source and documentation only; it does not extend to Yahoo Finance or exchange-provided data, trademarks, or other third-party materials.