Statistical Inference & Regression Models Flashcards
16 cards from real MS-DS Master of Data science practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 16 Statistical Inference & Regression Models flashcards as text
Given that beliefs adhere to specific laws, which of the following best describes the probability calculus of beliefs?
Answer: Bayesian probability
Bayesian probability is a framework where probability is interpreted as a degree of belief or subjective confidence in an event. It provides a mathematical system for representing and updating these beliefs based on new evidence, adhering to specific laws of probability calculus. This approach contrasts with frequentist probability, which defines probability based on the long-run frequency of events.
Identify the accurate statement.
Answer: Bayesian inference is the use of Bayesian probability representation of beliefs to perform inference
Bayesian inference is a statistical method that uses Bayes' theorem to update the probability for a hypothesis as more evidence or information becomes available. It fundamentally relies on the Bayesian interpretation of probability, where probabilities represent degrees of belief. This allows for a coherent framework to reason about uncertainty and make decisions based on updated beliefs.
Which of the aforementioned is a random variable?
Answer: All of the above
A random variable is a variable whose value is a numerical outcome of a random phenomenon. The outcome of an exam (e.g., a score), the outcome of a coin flip (e.g., heads/tails mapped to 0/1), and the outcome of a die roll (e.g., numbers 1-6) are all examples where the result is uncertain and determined by chance. Therefore, all listed options qualify as random variables.
Which one of the following random variables has a finite number of possible outcomes?
Answer: Discrete
A discrete random variable is one that can take on a finite or countably infinite number of distinct values. For instance, the number of heads in a series of coin flips or the outcome of a die roll are discrete. In contrast, a continuous random variable can take any value within a given range, having an uncountably infinite number of possible outcomes.
The center of the distribution of a random variable is its anticipated value, or .
Answer: mean
The anticipated value, or expected value, of a random variable is its mean. It represents the long-run average value of the variable if the experiment were repeated many times. The mean serves as a central measure of the distribution, indicating where the values tend to cluster.
Identify the accurate statement.
Answer: None of the above
A cumulative distribution function (CDF), F(x), for a random variable X, must satisfy specific properties. It must be non-decreasing, meaning F(x1) <= F(x2) for x1 < x2, and it must be right-continuous. It is not necessarily left-continuous and cannot be decreasing. Therefore, none of the provided statements accurately describe all the necessary properties of a CDF.
Which of the following describes a random variable's spread?
Answer: variance
Variance is a key measure of the spread or dispersion of a random variable's distribution. It quantifies how far, on average, the values of a random variable are from its expected value (mean). A higher variance indicates that data points are generally spread out further from the mean, while a lower variance indicates they are clustered closer to the mean.
The term "_______ deviation" refers to the square root of variance.
Answer: standard
The standard deviation is defined as the square root of the variance. It is a widely used measure of the spread of data around the mean. Unlike variance, standard deviation is expressed in the same units as the data itself, making it more interpretable and easier to understand in practical contexts.
The degrees of freedom in the Chi-squared distribution are twice as many.
Answer: variance
For a Chi-squared distribution, the degrees of freedom (often denoted as 'k') define its shape and properties. The mean of a Chi-squared distribution is equal to its degrees of freedom (k), and its variance is equal to twice its degrees of freedom (2k). Therefore, the degrees of freedom are directly related to, and half of, the variance.
Identify the accurate statement.
Answer: All of the above
An estimator is considered consistent if, as the sample size increases, it converges in probability to the true parameter value it is estimating. Asymptotics, which study the behavior of statistical procedures as sample size approaches infinity, are incredibly useful for understanding estimator properties, simplifying statistical inference, and providing robust approximations. All the statements accurately describe important aspects of statistical theory and practice.
Who among the following scientists created the Gosset's distribution?
Answer: William Gosset
The Gosset's distribution, more commonly known as the Student's t-distribution, was developed by William Sealy Gosset. He published his work under the pseudonym 'Student' while working at Guinness brewery, as the company had a policy against employees publishing research under their own names.
Identify the accurate statement.
Answer: All of the above
The empirical standard deviation measures the spread of observed data points around their mean, quantifying variability. The mean itself is a fundamental measure of central tendency, indicating the average value of a dataset. The empirical mean (sample mean) is directly used to 'center' random variables by subtracting it, resulting in data centered at zero. All these statements are accurate descriptions of basic statistical concepts.
Which of the following suggests there is no association between any of the relationships?
Answer: Cor(X, Y) = 0
The correlation coefficient, Cor(X, Y), measures the strength and direction of the linear relationship between two random variables X and Y. A value of 0 indicates that there is no linear association between the variables. It's important to note that a correlation of 0 does not necessarily imply independence, as non-linear relationships might still exist.
Centered at ___, normalized data have units equal to the standard deviations of the original data.
Answer: 0
Normalized data, typically achieved through standardization (e.g., z-score transformation), involves subtracting the mean and dividing by the standard deviation. This process results in data with a mean of 0 and a standard deviation of 1. Therefore, normalized data are always centered at 0.
Identify the error in the statement.
Answer: Adding squared terms makes it twice continuously differentiable at the knot points
In the context of splines, adding squared terms (as in a quadratic spline) makes the function continuously differentiable (C1) at the knot points. To achieve twice continuous differentiability (C2) at the knot points, which ensures even smoother transitions, cubic splines (involving cubed terms) are typically required. Therefore, stating that adding *only* squared terms makes it twice continuously differentiable is an error, as it generally only guarantees C1.
Which of the following is an illustration of Poisson distribution use?
Answer: All of the above
The Poisson distribution is a discrete probability distribution that models the number of events occurring in a fixed interval of time or space, given a constant average rate. It is widely applicable for various scenarios involving count data, such as modeling disease incidence rates, the number of web traffic hits on a server, or analyzing counts in contingency tables. All the listed options are valid applications.