Entropia Conjunta H(X,Y)
- Created by
- Renato Passos, Eng. de Software
- Reviewed by
- Renato Passos, Eng. de Software
Last updated: Apr 18, 2026
About this calculator
The Joint Entropy Calculator is an online tool that calculates the joint entropy of two random variables X and Y. Joint entropy is a measure of uncertainty or entropy that exists in a system with two variables. It is calculated using the formula −∑∑ p log₂ p, where p is the joint probability of X and Y.
Joint entropy is a generalization of Shannon entropy for two variables. It can be used to measure the amount of information that two variables contain together. This is particularly useful in information theory, signal processing, and data analysis. Joint entropy can be greater than, less than, or equal to the sum of the individual entropies of X and Y.
When using the Joint Entropy Calculator, you can gain insights into the relationship between two random variables. For example, if the joint entropy is less than the sum of the individual entropies, this may indicate that the variables are related and that there is redundancy of information between them. If the joint entropy is greater than the sum of the individual entropies, this may indicate that the variables are independent and that there is more uncertainty in the system.
It's essential to be cautious when interpreting joint entropy results. Joint entropy is not a measure of causality or correlation between variables, but rather a measure of joint uncertainty. Additionally, joint entropy can be sensitive to the discretization of variables and the choice of logarithm base.
Frequently asked questions
What is joint entropy?
Joint entropy is a measure of uncertainty or entropy that exists in a system with two random variables X and Y.
How is joint entropy calculated?
Joint entropy is calculated using the formula −∑∑ p log₂ p, where p is the joint probability of X and Y.
What is joint entropy used for?
Joint entropy is used to measure the amount of information that two variables contain together and can be used in information theory, signal processing, and data analysis.
Is joint entropy a measure of correlation between variables?
No, joint entropy is not a measure of correlation or causality between variables, but rather a measure of joint uncertainty.