A web application for analyzing portfolios and performance metrics of eToro's most popular investors. Provides data-driven insights into investor behavior, portfolio composition, and market sentiment across 1,500 popular investors.
🔗 Live Dashboard: weirdapps.github.io/etoro_census 📊 Vercel Deployment: etoro-census.vercel.app 👤 Author's eToro Profile: @plessas
This tool analyzes eToro's popular investors to provide:
- Portfolio composition and diversification metrics
- Cash allocation patterns across investors
- Performance distribution analysis
- Risk appetite insights
- Market sentiment indicators
The analysis processes data from up to 1,500 popular investors and generates comprehensive reports with interactive visualizations.
- Fear & Greed Index: Sentiment indicator based on average cash holdings (30% cash = 0 display, 0% cash = 100 display)
- Portfolio Diversification: Distribution of unique instruments across portfolios
- Cash Allocation: Cash percentage patterns with risk implications
- Returns Analysis: Performance distribution (Yesterday, Week-to-Date, Month-to-Date)
- Risk Profiles: Risk score distribution (Conservative to Very High Risk)
- Trading Activity: Average trades count and win ratios
- Ranked by copiers (social proof metric)
- Profile information and performance data
- YTD gains, trade statistics, risk scores
- Cash percentage indicators
- Paginated display (20 per page)
- Most common instruments across portfolios
- Average allocation percentages
- Recent performance data (Yesterday/WTD/MTD returns)
- Asset details and ownership statistics
- Color-coded return indicators
- Server-Sent Events for progress updates
- Detailed phase-by-phase status messages
- Handles 1,500 investors efficiently
- Comprehensive error recovery
- Framework: Next.js 15.2.4 with App Router
- Language: TypeScript with strict typing
- Styling: Tailwind CSS + Radix UI components
- Validation: Zod schemas
- Analytics: Vercel Analytics + Speed Insights
- API: RESTful endpoints with streaming support
- Data Collection: Single-pass architecture with circuit breakers
- Error Handling: Adaptive delays and timeout protection
- Export: JSON data with comprehensive details
- Deployment: Vercel (production) + GitHub Pages (reports)
- Automation: Daily reports via GitHub Actions (00:00 UTC)
- Monitoring: Real-time performance tracking
The application uses an optimized data collection strategy:
- One comprehensive API fetch per analysis
- Multiple analysis bands from same dataset (100/500/1000/1500 investors)
- Circuit breakers with adaptive error handling
- 30-second timeouts with graceful fallbacks
- Smart batching (50 items per call)
- DataCollectionService: Handles all API interactions with progress tracking
- AnalysisService: Generates insights from collected data
- InstrumentService: Manages asset information
- UserService: Handles investor data and authentication
src/
├── app/ # Next.js App Router
│ ├── api/ # API routes
│ │ ├── optimized-report/ # Main analysis endpoint
│ │ ├── census-stream/ # Streaming analysis
│ │ ├── extract-instruments/ # Instrument utilities
│ │ └── public/[username]/ # Individual investor data
│ ├── v2/ # V2 interface routes
│ ├── globals.css # Global styles
│ ├── layout.tsx # Root layout with analytics
│ └── page.tsx # Main dashboard
├── components/
│ ├── analytics.tsx # Vercel analytics wrapper
│ ├── census/ # Analysis components
│ │ ├── fear-greed-gauge.tsx
│ │ ├── portfolio-diversification.tsx
│ │ ├── top-holdings.tsx
│ │ └── top-performers.tsx
│ ├── ui/ # Reusable UI components
│ └── Disclaimer.tsx # Legal disclaimers
├── lib/
│ ├── models/ # TypeScript interfaces
│ ├── services/ # Business logic
│ │ ├── data-collection-service.ts
│ │ ├── analysis-service.ts
│ │ └── user-service.ts
│ ├── etoro-api-config.ts # API configuration
│ └── utils.ts # Utility functions
└── middleware.ts # Next.js middleware
analysis/ # Analysis tools
├── daily-post.js # Daily census updates
├── weekly-post.js # Weekly summaries
├── monthly-post.js # Monthly reports
├── hot-hands.js # Winning streak analysis
├── follower-distribution/ # Follower analysis tools
├── performance-comparison/ # Performance tools
└── risk-return/ # Risk/return analysis
.github/workflows/ # Automation
├── daily-census.yml # Daily report generation
└── deploy-pages.yml # GitHub Pages deployment
- Node.js 18+
- npm/yarn/pnpm
- eToro API credentials
-
Clone and install:
git clone <repository-url> cd etoro_census npm install
-
Configure environment (
.env.local):ETORO_API_BASE_URL=https://www.etoro.com/api/public ETORO_API_KEY=your_api_key_here ETORO_USER_KEY=your_user_key_here
-
Run development server:
npm run dev
Navigate to http://localhost:3600
npm run build
npm startGenerate formatted updates for the eToro community:
# Daily market update with Fear & Greed Index
node analysis/daily-post.js
# Weekly summary with trend analysis
node analysis/weekly-post.js
# Monthly comprehensive report
node analysis/monthly-post.js
# Generate all posts at once
node analysis/generate-all-posts.jsFeatures:
- Unicode sans-serif bold formatting (eToro compatible)
- Copier activity tracking (daily/weekly/monthly gainers/losers)
- Top 100 vs. broad market performance comparisons
- Adaptive insights based on data
# Hot hands - investors on winning streaks
node analysis/hot-hands.js
# Momentum-based analysis
node analysis/hot-hands-momentum.js
# Follower distribution charts
cd analysis/follower-distribution
node generate-follower-chart.js- Risk vs Return: Interactive charts (see
analysis/risk-return/README.md) - Performance Comparison: Outperformance analysis tools
- Follower Distribution: Power law analysis across all 1,500 investors
X-API-KEY: eToro API authentication key
X-USER-KEY: User-specific authorization
X-REQUEST-ID: UUID for request tracking
- Popular Investors:
/v1/user-info/people/search - Portfolios:
/v1/user-info/people/{username}/portfolio/live - Trade Info:
/v1/user-info/people/{username}/tradeinfo?period=currYear - Instruments:
/v1/market-data/instruments - Closing Prices:
/v1/market-data/instruments/history/closing-price - User Details:
/v1/user-info/people(avatars, profiles)
GitHub Actions workflow runs daily at 00:00 UTC:
- Analyzes all 1,500 popular investors
- Generates HTML reports and JSON data
- Deploys to GitHub Pages
- Triggers Vercel deployment
# Deploy to Vercel
vercel --prod
# Or push to master branch (auto-deploys)
git push origin master- Range: 1-1500 investors (validated)
- Default: 100 investors
- API Limit: eToro caps at exactly 1,500 popular investors
- Year to Date (default)
- Current Month/Quarter
- Historical periods (1, 3, 6 months ago)
- Last Year/Two Years
- Single-pass collection eliminates redundant API calls
- Circuit breakers prevent cascade failures
- Adaptive delays based on error rates (75ms to 1500ms)
- 30-second timeouts with graceful recovery
- Batch processing (50 items per API call)
- Zero API calls for analysis (uses pre-collected data)
- Multiple investor bands processed simultaneously
- Shared dataset across all analysis types
- Fast processing without network delays
- Disk space optimization (removes unnecessary SDKs)
- Efficient artifact handling (last 7 days of reports)
- Build cache cleanup
- Monitoring and error tracking
- TypeScript with strict typing
- ESLint + Prettier configuration
- Consistent naming conventions
- Comprehensive error handling
- Functional components with hooks
- Typed props interfaces
- Responsive Tailwind CSS design
- Accessibility considerations
- eToro API limit: exactly 1,500 popular investors (hard cap)
- Some investors may have incomplete profile data
- Instrument data availability varies by market hours
- Historical data limited to available closing prices
- Rate limiting handled via circuit breakers
Important: This project is for educational and informational purposes only.
- Not Financial Advice: Does not constitute financial, investment, or trading advice
- No eToro Affiliation: Independent project, not endorsed by eToro
- Data Accuracy: Provided "as is" without warranties
- Risk Warning: Trading involves substantial risk of loss
Always consult with a qualified financial advisor before making investment decisions.
This project is for educational and analysis purposes. Please ensure compliance with eToro's API terms of service.
For questions or issues:
- Check existing documentation
- Review CLAUDE.md for development context
- Create an issue in the repository