Skill v1.0.1
currentAutomated scan100/1003 files
version: "1.0.1" name: renaissance-statistical-arbitrage description: Build trading systems in the style of Renaissance Technologies, the most successful quantitative hedge fund in history. Emphasizes statistical arbitrage, signal processing, and rigorous scientific methodology. Use when developing alpha research, signal extraction, or systematic trading strategies.
Renaissance Technologies Style Guide
Overview
Renaissance Technologies, founded by mathematician Jim Simons, operates the Medallion Fund—the most successful hedge fund in history with ~66% annual returns before fees over 30+ years. The firm hires mathematicians, physicists, and computer scientists (not finance people) and applies rigorous scientific methods to market data.
Core Philosophy
"We don't hire people from business schools. We hire people from the hard sciences."
"Patterns in data are ephemeral. If something works, it's probably going to stop working."
"We're not in the business of predicting. We're in the business of finding patterns that repeat slightly more often than they should."
Renaissance believes markets are not perfectly efficient but nearly so. Profits come from finding tiny, statistically significant edges and exploiting them at massive scale with rigorous risk management.
Design Principles
- Scientific Method: Form hypotheses, test rigorously, reject most ideas.
- Signal, Not Prediction: Find patterns that repeat more often than chance; don't predict the future.
- Decay Awareness: Every signal degrades over time. Continuous research is survival.
- Statistical Significance: If it's not statistically significant, it doesn't exist.
- Ensemble Everything: Combine thousands of weak signals into robust strategies.
When Building Trading Systems
Always
- Demand statistical significance (p < 0.01 minimum, ideally much lower)
- Account for multiple hypothesis testing (Bonferroni, FDR correction)
- Test on out-of-sample data with proper temporal separation
- Model transaction costs, slippage, and market impact
- Assume every signal will decay—build infrastructure for continuous research
- Combine signals orthogonally (uncorrelated sources of alpha)
Never
- Trust a backtest without out-of-sample validation
- Ignore survivorship bias, lookahead bias, or selection bias
- Assume past correlations will persist
- Over-optimize on historical data (curve fitting)
- Trade on intuition or narrative
- Assume a signal will last forever
Prefer
- Hidden Markov models for regime detection
- Spectral analysis for cyclical patterns
- Non-linear methods for complex relationships
- Ensemble methods over single models
- Short holding periods (faster signal decay detection)
- Statistical tests over visual inspection
Code Patterns
Rigorous Backtesting Framework
class RenaissanceBacktester:"""Renaissance-style backtesting: paranoid about biases."""def __init__(self, strategy, universe):self.strategy = strategyself.universe = universeself.results = []def run(self, start_date, end_date,train_window_days=252,test_window_days=63,embargo_days=5):"""Walk-forward validation with embargo period.Never let training data leak into test period."""current = start_datewhile current + timedelta(days=train_window_days + test_window_days) <= end_date:train_end = current + timedelta(days=train_window_days)# EMBARGO: gap between train and test to prevent leakagetest_start = train_end + timedelta(days=embargo_days)test_end = test_start + timedelta(days=test_window_days)# Train on historical datatrain_data = self.get_point_in_time_data(current, train_end)self.strategy.fit(train_data)# Test on future data (strategy cannot see this during training)test_data = self.get_point_in_time_data(test_start, test_end)returns = self.strategy.execute(test_data)self.results.append({'train_period': (current, train_end),'test_period': (test_start, test_end),'returns': returns,'sharpe': self.calculate_sharpe(returns)})current = test_endreturn self.analyze_results()def get_point_in_time_data(self, start, end):"""CRITICAL: Return data as it existed at each point in time.No future information, no restated financials, no survivorship bias."""return self.universe.get_pit_snapshot(start, end)def analyze_results(self):"""Statistical analysis of walk-forward results."""returns = [r['returns'] for r in self.results]# t-test: is mean return significantly different from zero?t_stat, p_value = stats.ttest_1samp(returns, 0)return {'mean_return': np.mean(returns),'sharpe_ratio': np.mean(returns) / np.std(returns) * np.sqrt(252),'t_statistic': t_stat,'p_value': p_value,'significant': p_value < 0.01,'n_periods': len(self.results)}
Signal Combination with Decay Tracking
class SignalEnsemble:"""Renaissance insight: combine many weak signals.Track decay and retire dying signals."""def __init__(self, decay_halflife_days=30):self.signals = {} # signal_id -> SignalModelself.performance = {} # signal_id -> rolling performanceself.decay_halflife = decay_halflife_daysdef add_signal(self, signal_id, model, weight=1.0):self.signals[signal_id] = {'model': model,'weight': weight,'created_at': datetime.now(),'alive': True}self.performance[signal_id] = RollingStats(window=252)def generate_combined_signal(self, features):"""Weighted combination of orthogonal signals.Signals with decayed performance get lower weights."""predictions = {}weights = {}for signal_id, signal in self.signals.items():if not signal['alive']:continuepred = signal['model'].predict(features)# Weight by original weight × recent performanceperf = self.performance[signal_id]decay_weight = self.calculate_decay_weight(perf)predictions[signal_id] = predweights[signal_id] = signal['weight'] * decay_weight# Normalize weightstotal_weight = sum(weights.values())if total_weight == 0:return 0.0combined = sum(predictions[sid] * weights[sid] / total_weightfor sid in predictions)return combineddef update_performance(self, signal_id, realized_return, predicted_direction):"""Track whether signal correctly predicted direction."""correct = (realized_return > 0) == (predicted_direction > 0)self.performance[signal_id].add(1.0 if correct else 0.0)# Kill signals that have decayed below thresholdif self.performance[signal_id].mean() < 0.51: # Barely better than randomself.signals[signal_id]['alive'] = Falsedef calculate_decay_weight(self, perf):"""Exponential decay based on recent hit rate."""hit_rate = perf.mean()# Scale: 50% hit rate = 0 weight, 55% = 0.5, 60% = 1.0return max(0, (hit_rate - 0.50) * 10)
Hidden Markov Model for Regime Detection
class MarketRegimeHMM:"""Renaissance-style regime detection using Hidden Markov Models.Markets exhibit different statistical properties in different regimes."""def __init__(self, n_regimes=3):self.n_regimes = n_regimesself.model = Noneself.regime_stats = {}def fit(self, returns, volume, volatility):"""Fit HMM to market observables.Discover latent regimes from price/volume/volatility patterns."""# Stack observables into feature matrixobservations = np.column_stack([returns,np.log(volume + 1),volatility])self.model = hmm.GaussianHMM(n_components=self.n_regimes,covariance_type='full',n_iter=1000)self.model.fit(observations)# Decode to get most likely regime sequenceregimes = self.model.predict(observations)# Characterize each regimefor regime in range(self.n_regimes):mask = regimes == regimeself.regime_stats[regime] = {'mean_return': returns[mask].mean(),'volatility': returns[mask].std(),'frequency': mask.mean(),'mean_duration': self.calculate_duration(regimes, regime)}return selfdef current_regime(self, recent_observations):"""Infer current regime from recent data."""probs = self.model.predict_proba(recent_observations)return np.argmax(probs[-1])def regime_adjusted_signal(self, base_signal, current_regime):"""Adjust signal strength based on regime."""regime = self.regime_stats[current_regime]# Scale signal inversely with volatility# (same signal in high-vol regime should have smaller position)vol_adjustment = 0.15 / regime['volatility'] # Target 15% volreturn base_signal * vol_adjustment
Multiple Hypothesis Testing Correction
class AlphaResearch:"""Renaissance approach: test thousands of hypotheses,but correct for multiple testing to avoid false discoveries."""def __init__(self, significance_level=0.01):self.alpha = significance_levelself.tested_hypotheses = []def test_signal(self, signal_name, returns, predictions):"""Test if a signal has predictive power."""# Information Coefficient: correlation of prediction with outcomeic = stats.spearmanr(predictions, returns)# t-test for significancen = len(returns)t_stat = ic.correlation * np.sqrt(n - 2) / np.sqrt(1 - ic.correlation**2)p_value = 2 * (1 - stats.t.cdf(abs(t_stat), n - 2))self.tested_hypotheses.append({'signal': signal_name,'ic': ic.correlation,'t_stat': t_stat,'p_value': p_value})return p_valuedef get_significant_signals(self, method='fdr'):"""After testing many signals, apply multiple testing correction."""p_values = [h['p_value'] for h in self.tested_hypotheses]if method == 'bonferroni':# Most conservative: divide alpha by number of testsadjusted_alpha = self.alpha / len(p_values)significant = [h for h in self.tested_hypothesesif h['p_value'] < adjusted_alpha]elif method == 'fdr':# Benjamini-Hochberg: control false discovery ratesorted_hypotheses = sorted(self.tested_hypotheses, key=lambda x: x['p_value'])significant = []for i, h in enumerate(sorted_hypotheses):# BH threshold: (rank / n_tests) * alphathreshold = ((i + 1) / len(p_values)) * self.alphaif h['p_value'] <= threshold:significant.append(h)else:break # All remaining will also failreturn significant
Mental Model
Renaissance approaches trading by asking:
- Is there a pattern? Statistical test, not eyeballing
- Is it significant? After multiple testing correction?
- Is it robust? Out-of-sample, different time periods, different instruments?
- Will it persist? What's the economic rationale for why this shouldn't be arbitraged away?
- How will it decay? What's the monitoring plan?
Signature Renaissance Moves
- Hire scientists, not traders
- Thousands of small signals, not a few big ones
- Paranoid about data snooping and overfitting
- Hidden Markov models for regime detection
- Signal decay tracking and retirement
- Rigorous walk-forward validation
- Multiple hypothesis testing correction
- Point-in-time data to prevent lookahead bias