第 3 / 3 页
非代码面试题
显示 20 / 60 道匹配题目
答题状态：未尝试未正确已正确
ID题目领域难度题型进度权限
1721Switching to One-Sided After Seeing the SignA two-sided test is not significant, but the estimated coefficient has the expected sign. The analyst then reports the one-sided p-value instead. Why is that invalid if the direction was chosen after looking at the data?统计中等essay未尝试面试订阅1722Cherry-Picked EndpointA note tests 12 strategy diagnostics but highlights only the one with p = 0.02. What trap should the reviewer flag?统计简单essay未尝试免费1723Underpowered Winner’s CurseA sparse signal library was screened on short samples; the surviving signal is significant but came from a very low-power environment. Why should its in-sample effect size be viewed skeptically?统计中等essay未尝试面试订阅1724Conditioning Direction ErrorA reviewer writes: ‘p = 0.07 means the null hypothesis is true with probability 7%.’ What is wrong with the conditioning direction?统计简单essay未尝试免费1725Fail to Reject vs AcceptAn experiment does not reject the null at 5%. The team writes ‘the null is accepted.’ What is the correct correction?统计简单essay未尝试免费1726Design Effect Under Clustered AssignmentAn experiment randomizes by store rather than by customer. If the average cluster size is m and the intra-cluster correlation is , what is the standard design-effect multiplier on variance?统计中等derivation未尝试面试订阅1727Effective Sample Size After a CUPED-Style Variance ReductionA variance-reduction method shrinks the variance of the treatment-effect estimator by a factor of c where 0<c<1. By what factor does the effective sample size increase?统计中等derivation未尝试面试订阅1728Triggered Analysis Exposure FractionOnly a fraction q of randomized users ever encounter the feature being tested. If the treatment effect exists only on those triggered users, how does the intent-to-treat effect compare with the triggered-user effect?统计中等derivation未尝试面试订阅1729Why Session-Level Randomization Can Leak Across UsersWhy can session-level randomization be misleading when the same user returns many times and behavior carries over across sessions?统计简单essay未尝试免费1730Why Daily Peeking Breaks a Fixed-Horizon ThresholdWhy does checking significance every day against an unadjusted fixed-horizon p-value threshold inflate false positives?统计中等essay未尝试面试订阅1731Why Triggered Analysis Can Beat a Naive Population AverageWhy can triggered analysis produce a cleaner estimate than averaging over all randomized users?统计简单essay未尝试免费1732Why Interference Can Ruin User-Level RandomizationWhy can an experiment on social or marketplace features violate the usual randomized-test logic even if assignment itself was truly random?统计简单essay未尝试免费1733Why Guardrail Metrics Matter Even When the Primary Metric WinsWhy is a primary-metric win not enough to ship an experiment if latency, complaints, or cancellation rates deteriorate?统计中等essay未尝试面试订阅1734Why Novelty Effects Can Fake a Long-Run WinWhy can a treatment look great in the first week of an experiment and disappoint later even if the implementation is correct?统计简单essay未尝试免费1735Why Ratio Metrics Need More Care Than CountsWhy do ratio metrics such as revenue per active user often require more design care than simple counts?统计中等essay未尝试面试订阅1736Why Small p-Values Still Need a Plausible Rollout StoryWhy should a team still ask whether an observed experiment win makes operational sense even when the p-value is tiny?统计中等essay未尝试面试订阅1737Why Blocking on Seasonality Can Beat Pure RandomizationWhy can blocking by weekday, region, or season reduce noise in an experiment even though randomization alone is already unbiased?统计简单essay未尝试免费1738Why Cluster Tests Need More Than a Big User CountWhy can an experiment with millions of users still have weak power if it randomizes only a small number of clusters?统计中等essay未尝试面试订阅1739Why a Short Experiment Can Misread a Delayed EffectWhy can an experiment that ends too early miss a treatment whose benefits arrive only after a usage-learning period?统计简单essay未尝试免费1740Why Switchback Tests Help With Time-Based SpilloversWhy can alternating treatment and control by time block be more credible than user-level randomization when the whole marketplace state carries over across nearby minutes?统计中等essay未尝试面试订阅