Jump to content
Main menu
Main menu
move to sidebar
hide
Navigation
Main page
Recent changes
Random page
Help about MediaWiki
Special pages
Niidae Wiki
Search
Search
Appearance
Create account
Log in
Personal tools
Create account
Log in
Pages for logged out editors
learn more
Contributions
Talk
Editing
Weighted arithmetic mean
(section)
Page
Discussion
English
Read
Edit
View history
Tools
Tools
move to sidebar
hide
Actions
Read
Edit
View history
General
What links here
Related changes
Page information
Appearance
move to sidebar
hide
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
====Reliability weights==== If the weights are instead ''reliability weights'' (non-random values reflecting the sample's relative trustworthiness, often derived from sample variance), we can determine a correction factor to yield an unbiased estimator. Assuming each random variable is sampled from the same distribution with mean <math>\mu</math> and actual variance <math>\sigma_{\text{actual}}^2</math>, taking expectations we have, :<math> \begin{align} \operatorname{E} [\hat \sigma^2] &= \frac{ \sum\limits_{i=1}^N \operatorname{E} [(x_i - \mu)^2]} N \\ &= \operatorname{E} [(X - \operatorname{E}[X])^2] - \frac{1}{N} \operatorname{E} [(X - \operatorname{E}[X])^2] \\ &= \left( \frac{N - 1} N \right) \sigma_{\text{actual}}^2 \\ \operatorname{E} [\hat \sigma^2_\mathrm{w}] &= \frac{\sum\limits_{i=1}^N w_i \operatorname{E} [(x_i - \mu^*)^2] }{V_1} \\ &= \operatorname{E}[(X - \operatorname{E}[X])^2] - \frac{V_2}{V_1^2} \operatorname{E}[(X - \operatorname{E}[X])^2] \\ &= \left(1 - \frac{V_2 }{ V_1^2}\right) \sigma_{\text{actual}}^2 \end{align} </math> where <math>V_1 = \sum_{i=1}^N w_i</math> and <math>V_2 = \sum_{i=1}^N w_i^2</math>. Therefore, the bias in our estimator is <math>\left(1 - \frac{V_2 }{ V_1^2}\right) </math>, analogous to the <math> \left( \frac{N - 1} {N} \right)</math> bias in the unweighted estimator (also notice that <math>\ V_1^2 / V_2 = N_{eff} </math> is the [[effective sample size#weighted samples|effective sample size]]). This means that to unbias our estimator we need to pre-divide by <math>1 - \left(V_2 / V_1^2\right) </math>, ensuring that the expected value of the estimated variance equals the actual variance of the sampling distribution. The final unbiased estimate of sample variance is: :<math> \begin{align} s^2_{\mathrm{w}}\ &= \frac{\hat \sigma^2_\mathrm{w}} {1 - (V_2 / V_1^2)} \\[4pt] &= \frac {\sum\limits_{i=1}^N w_i (x_i - \mu^*)^2} {V_1 - (V_2 / V_1)}, \end{align} </math><ref>{{cite web|url=https://www.gnu.org/software/gsl/manual/html_node/Weighted-Samples.html|title=GNU Scientific Library β Reference Manual: Weighted Samples|website=Gnu.org|access-date=22 December 2017}}</ref> where <math>\operatorname{E}[s^2_{\mathrm{w}}] = \sigma_{\text{actual}}^2</math>. The degrees of freedom of this weighted, unbiased sample variance vary accordingly from ''N'' β 1 down to 0. The standard deviation is simply the square root of the variance above. As a side note, other approaches have been described to compute the weighted sample variance.<ref>{{cite web |url=http://www.analyticalgroup.com/download/WEIGHTED_MEAN.pdf |title=Weighted Standard Error and its Impact on Significance Testing (WinCross vs. Quantum & SPSS), Dr. Albert Madansky| website=Analyticalgroup.com| access-date=22 December 2017}}</ref>
Summary:
Please note that all contributions to Niidae Wiki may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see
Encyclopedia:Copyrights
for details).
Do not submit copyrighted work without permission!
Cancel
Editing help
(opens in new window)
Search
Search
Editing
Weighted arithmetic mean
(section)
Add topic