

{"id":125665,"date":"2020-04-06T16:20:43","date_gmt":"2020-04-06T10:50:43","guid":{"rendered":"https:\/\/analyticstraining.com\/?p=15959"},"modified":"2022-11-22T16:48:20","modified_gmt":"2022-11-22T11:18:20","slug":"model-thinking-covid-19-a-brief-discussion-on-confusion-matrix","status":"publish","type":"post","link":"https:\/\/www.jigsawacademy.com\/model-thinking-covid-19-a-brief-discussion-on-confusion-matrix\/","title":{"rendered":"Model Thinking: COVID-19 &#8211; A brief discussion on Confusion Matrix"},"content":{"rendered":"<p><b>A brief discussion on Confusion Matrix &#8211;&nbsp;<\/b><span style=\"font-weight: 400;\">As the COVID-19 pandemic continues to ravage the world, India has done remarkably well. Even as global infections have crossed 1.2 million, India\u2019s number at around 4,000 seem model, given we are home to one-sixth of the world\u2019s population. In per capita terms, only 3 in a million people in India are infected by COVID-19, vs 156 in a million people globally (as of 5<\/span><span style=\"font-weight: 400;\">th<\/span><span style=\"font-weight: 400;\"> April 2020).<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><a href=\"https:\/\/timesofindia.indiatimes.com\/india\/low-testing-could-explain-indias-small-covid-numbers\/articleshow\/74661955.cms\" target=\"_blank\" rel=\"noopener\">A number of reasons have been suggested including a smaller number of tests<\/a>, <a href=\"https:\/\/www.msn.com\/en-in\/health\/in-depth\/does-bcg-protect-against-coronavirus-new-debate-over-old-vaccine\/ar-BB128HgM\" target=\"_blank\" rel=\"noopener\">BCG vaccine usage in India<\/a>, <a href=\"https:\/\/timesofindia.indiatimes.com\/life-style\/health-fitness\/health-news\/is-the-indian-covid-19-strain-weaker\/articleshow\/74823660.cms\" target=\"_blank\" rel=\"noopener\">Indian strain being less virulent<\/a>&nbsp;and Indians being more resistant to infections.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In this context, I seek to use the confusion matrix (also called error matrix and matching matrix in unsupervised learning) to discuss the impact of higher testing.&nbsp;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Students of my Quantitative Methods class would be familiar with the chart below.&nbsp; The confusion matrix tends to confuse a lot of the students. Its implications are underappreciated by many practitioners of statistics.<\/span><\/p>\n<h5><strong><a href=\"https:\/\/analyticstraining.com\/wp-content\/uploads\/2020\/04\/image1.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter wp-image-15960 size-full\" src=\"https:\/\/analyticstraining.com\/wp-content\/uploads\/2020\/04\/image1.png\" alt=\"\" width=\"462\" height=\"340\" title=\"\"><\/a>In brief, for any test, in medicine or otherwise, the results may have some error. These are classified as:<\/strong><\/h5>\n<p><span style=\"font-weight: 400;\"><strong>1. True Positive:<\/strong> A true positive is the correct affirmation of the presence of a condition<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, concluding a pregnant lady is pregnant would be \u201cTrue Positive\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><strong>2. False Negative:<\/strong> A false negative&nbsp;<\/span><span style=\"font-weight: 400;\">is an error in which a test result improperly indicates no presence of a condition (the result is&nbsp;<\/span><i><span style=\"font-weight: 400;\">negative<\/span><\/i><span style=\"font-weight: 400;\">), when in reality, the condition is present.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, concluding a pregnant lady is not pregnant would be \u201cFalse Negative\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><strong>3. False Positive:<\/strong> A false positive is the error in affirmation of the presence of a condition<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, concluding a man is pregnant would be \u201cFalse Positive\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><strong>4. True Negative:<\/strong> A true negative is the correct affirmation that the condition is not present&nbsp;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, concluding a man is not pregnant would be \u201cTrue Negative\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For any tests, some error will occur. Some infected people will be assumed to be uninfected (false negatives) and some uninfected people will show up being infected (false positives). What are the true positive rates (also called sensitivity) for the COVID-19 tests? We don\u2019t know yet.&nbsp;<\/span><\/p>\n<h5><strong>Let&#8217;s assume (this is hypothetical and not meant to be a forecast), that:&nbsp;<\/strong><\/h5>\n<ul>\n<li><span style=\"font-weight: 400;\">The current number of infections in India (3 infections per million population) , the infection rate in India is 10 people per million population (or 13,000 actually vs 4,000 reported)<\/span><\/li>\n<li><span style=\"font-weight: 400;\">The tests are very accurate and the sensitivity is 99.9% (or 99.9% of the infections are correctly reported)<\/span><\/li>\n<li><span style=\"font-weight: 400;\">There are some chances of true negatives, 0.01% (or 1 in 10,000 not infected will be shown to have&nbsp; an infection). This implies a true negative of 99.99%. This is higher than the true positive rate of 99.9%<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Now lets assume India has the money, resources, time and effort to get everyone in India tested. Yes, all 1.3 billion Indians. What would that mean? Think about this before you peep into the solution.&nbsp;<\/span><\/p>\n<h5><strong>We assume 10 in a million or 13,000 Indians are infected.&nbsp; This is the true number of infections:<\/strong><\/h5>\n<p><strong>1. True Positive:<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">99.9% will be correctly diagnosed or 12, 987 infected Indians will be confirmed to have been infected&nbsp;<\/span><\/p>\n<p><strong>2. False Negative:&nbsp;<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">0.1%&nbsp; (or 13 Indians) will be incorrectly diagnosed as being uninfected while they are infected<\/span><\/p>\n<p><strong>3. False Positive: A false positive is the error in affirmation of the presence of a condition<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">1,29,99,87,000 are uninfected. However, the false positive rate is 0.01%. As a result, 129,999 people who do not have the infection would have been diagnosed as being infected. This is around 10 times the actual number of infected.<\/span><b> As a result, if the medical test leads to even small false positives, excessive testing may overwhelm the medical system and make it difficult for the actual patents to get correct treatment.<\/b><\/p>\n<p><strong>4. True Negative: A true negative is the correct affirmation that the condition is not present&nbsp;<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">99.99% of the 1,29,99,87,000 uninfected (or 1,29,98,57,001) will be true negatives.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">However, we realize how excessive testing and even small false positives can impact us in ways we do not realize. Currently, 3% of COVID-19 tests lead to confirmation of infections. We are testing 33x more than actual infections which is better than most nations and in line with South Korea, among the best in testing its citizens. India is already testing 97% of the people who end up not being infected. We may infer that we are testing more likely and possible cases than most western nations already.<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><a href=\"https:\/\/analyticstraining.com\/wp-content\/uploads\/2020\/04\/image2.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter wp-image-15961 size-full\" src=\"https:\/\/analyticstraining.com\/wp-content\/uploads\/2020\/04\/image2.png\" alt=\"\" width=\"596\" height=\"473\" title=\"\"><\/a>Are we testing enough? Should we test more? I am not a medical practitioner, and will let more capable minds decide on the testing rates.<\/span><\/p>\n<p><strong>What do you think? Would love to hear your thoughts and comments.<\/strong><\/p>\n<p><span style=\"font-weight: 400;\">Disclaimer: I offer my views, with the knowledge that medicine, and health is not my area of expertise. Also, given that many discussions on the topic have been polarized by political leanings and viewpoints, I would like to stress that these are not to promote any ideology.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A brief discussion on Confusion Matrix &#8211;&nbsp;As the COVID-19 pandemic continues to ravage the world, India has done remarkably well. Even as global infections have crossed 1.2 million, India\u2019s number at around 4,000 seem model, given we are home to one-sixth of the world\u2019s population. In per capita terms, only 3 in a million people [&hellip;]<\/p>\n","protected":false},"author":168,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1496,1262],"tags":[1368,1355,1367,1369,806],"form":[1499],"acf":[],"_links":{"self":[{"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/posts\/125665"}],"collection":[{"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/users\/168"}],"replies":[{"embeddable":true,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/comments?post=125665"}],"version-history":[{"count":1,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/posts\/125665\/revisions"}],"predecessor-version":[{"id":260050,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/posts\/125665\/revisions\/260050"}],"wp:attachment":[{"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/media?parent=125665"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/categories?post=125665"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/tags?post=125665"},{"taxonomy":"form","embeddable":true,"href":"https:\/\/www.jigsawacademy.com\/wp-json\/wp\/v2\/form?post=125665"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}