{"id":793,"date":"2024-08-19T16:06:54","date_gmt":"2024-08-19T19:06:54","guid":{"rendered":"https:\/\/staging-brasil.mapbiomas.org\/?page_id=793"},"modified":"2026-02-12T16:10:24","modified_gmt":"2026-02-12T19:10:24","slug":"analise-de-acuracia","status":"publish","type":"page","link":"https:\/\/brasil.mapbiomas.org\/en\/analise-de-acuracia\/","title":{"rendered":"Accuracy analysis"},"content":{"rendered":"

ACCURACY ASSESSMENT ANALYSIS OF MAPBIOMAS' LAND COVER MAPPING<\/h4>\n\n\n\n\n\n

ACCESS THE ACCURACY STATISTICS PANEL FOR THE COLLECTIONS<\/a><\/p>\n\n\n\n\n\n

Accuracy analysis is the main way to evaluate the quality of the mapping performed by MapBiomas. In addition to stating the overall success rate, the accuracy analysis also reveals estimates of the success and error rates for each mapped class. MapBiomas evaluated the global and per-class land use and land cover accuracy for all years between 1985 and 2024.<\/p>\n\n\n\n

Accuracy estimates were based on the evaluation of a pixel sample, which we call the reference database, consisting of ~ 75.000 samples. The number of pixels in the reference database was predetermined by statistical sampling techniques. Each year, each pixel from the reference database was evaluated by technicians trained in visual interpretation of Landsat images. Accuracy was assessed using metrics that compare the mapped class with the class evaluated by the technicians in the reference database. dados de refer\u00eancia<\/strong>, composta por ~85.000 amostras. O n\u00famero de p\u00edxeis na base de dados de refer\u00eancia<\/strong> was pre-determined using statistical sampling techniques. Each year, each pixel in the reference dataset was assessed by technicians trained in visual interpretation of Landsat images. The accuracy assessment was conducted using metrics that compare the mapped class with the class evaluated by the technicians in the reference dataset.<\/p>\n\n\n\n

In each year, the accuracy analysis is done by cross-tabulating the sample frequencies of the mapped and real classes, in the format of Table 1. The frequencies\u00a0ni,j<\/sub><\/em><\/strong>\u00a0represent the number of pixels in the sample classified as class i, and evaluated as class j. The line marginal totals,\"\", represent the number of samples mapped as class i, while the column marginal totals,\"\"\u00a0, represent the number of samples that were evaluated by the technicians as class j. Table 1 is commonly called the\u00a0error matrix<\/strong>\u00a0or\u00a0confusion matrix<\/strong>.<\/p>\n\n\n\n

Table 1:<\/strong> Generic sample error matrix<\/p>\n\n\n\n\n\n

\"\"<\/figure>\n\n\n\n\n\n

From the results in Table 1, the sample proportions in each cell of the table are estimated by \"\"\u00a0\"\". The matrix of values \"\"\u00a0 is used to estimate:<\/p>\n\n\n\n

    \n
  1. User\u2019s Accuracies: <\/strong>These are the estimates of the fractions of pixels, for each classified class, correctly classified. The user\u2019s accuracy is associated with the error of commission, which is the error of assigning a pixel to class i, when it belongs to some other class. The user\u2019s accuracy for class i is estimated by Formula6 and the commission error by Formula7. These metrics are associated with the reliability of each classified class.<\/li>\n\n\n\n
  2. Producer\u2019s Accuracies:<\/strong> Are the sample fraction of pixels of each land cover\/use class correctly assigned to their classes by the classifiers. The producer's accuracy is associated with the omission error<\/strong>, which occurs when we fail to map a class j pixel correctly. The producer 's accuracy for class j is estimated by \"\" and the omission error<\/strong> by \"\". These metrics are associated with the sensitivity<\/strong> of the classifier, that is, the ability to correctly distinguish one class from another.<\/li>\n\n\n\n
  3. Global Accuracy It is the estimate of the overall hit rate. The estimate is given by Formula10 n, the sum of the main diagonal of the proportions matrix. The complement of the total accuracy, or the total error Formula11 is still decomposed into area (or quantity) disagreement and allocation disagreement1. Area disagreement measures the fraction of the error attributed to the amount of area allocated incorrectly to the classes by the mapping, while the mismatch allocation to the ratio of class-displacement errors.<\/li>\n<\/ol>\n\n\n\n

    The matrix also provides estimates of the different types of errors. For example, we show estimates of true class area composition in each mapping class. Thus, in addition to the hit rate of the class mapped as forest, for example, we also estimate the fraction of these areas that could be pasture or other classes of cover and land use, for each year. We understand that this level of transparency informs users and maximizes the potential of use across multiple types of users. For this, we build an aplication<\/a> to facilitate the visualization of the accuracy and the errors of the mapping<\/p>\n\n\n\n

    1- Pontius Jr, R. G., & Millones, M. (2011). Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment. International Journal of Remote Sensing, 32(15), 4407-4429.<\/a><\/small><\/p>\n\n\n\n\n\n

    \n\n\n\n\n\n

    ABOUT THE GRAPHICS<\/h2>\n\n\n\n

    OVERALL STATISTICS<\/h4>\n\n\n\n

    They show the mean annual total accuracy and the error, decomposed in area and allocation disagreements.<\/p>\n\n\n\n\n\n

    \"\"<\/p>\n\n\n\n\n\n

    GRAPH 1. ANNUAL TOTAL ACCURACY CHART:<\/h4>\n\n\n\n

    This graph shows the total accuracy and the total error per year. The total error is decomposed into area and allocation disagreements. Accuracy is plotted at the top and errors at the bottom of the chart.<\/p>\n\n\n\n\n\n

    \"\"<\/figure>\n\n\n\n\n\n

    GRAPH 2. MATRIX OF ERROS:<\/h4>\n\n\n\n

    This graph shows the user\u2019s and producer\u2019s accuracy, and the confusions between classes for each year. The first shows the confusions for each mapped class. The second shows the confusions for each real class.<\/p>\n\n\n\n\n\n

    \"\"<\/figure>\n\n\n\n\n\n
    \"\"<\/figure>\n\n\n\n\n\n

    GRAPH 3. CLASS HISTORY:<\/h4>\n\n\n\n

    This graph allows you to inspect the confusions of a particular class over time. The user\u2019s r and producer\u2019s accuracies for each class is displayed along with the confusions in each year.<\/p>\n\n\n\n\n\n

    \"\"<\/figure>\n\n\n\n\n\n
    \"\"<\/figure>\n\n\n\n\n\n

    ACCESS THE ACCURACY STATISTICS PANEL FOR THE COLLECTIONS<\/a><\/p>","protected":false},"excerpt":{"rendered":"

    ESTIMATIVAS DA ACUR\u00c1CIA DO MAPEAMENTO DA COBERTURA DA TERRA PELO PROJETO MAPBIOMAS ACESSE O PAINEL DE ESTAT\u00cdSTICA DE ACUR\u00c1CIA DAS COLE\u00c7\u00d5ES A an\u00e1lise de acur\u00e1cia \u00e9 a principal forma de avalia\u00e7\u00e3o da qualidade do mapeamento realizado pelo MapBiomas. Al\u00e9m de dizer qual a taxa de acerto geral, a an\u00e1lise de acur\u00e1cia tamb\u00e9m revela estimativas das […]<\/p>","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_uag_custom_page_level_css":""},"acf":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"trp-custom-language-flag":false,"infographic":false,"team":false},"uagb_author_info":{"display_name":"Adriel Fernandes","author_link":"https:\/\/brasil.mapbiomas.org\/en\/author\/adriel-fernandes\/"},"uagb_comment_info":0,"uagb_excerpt":"ESTIMATIVAS DA ACUR\u00c1CIA DO MAPEAMENTO DA COBERTURA DA TERRA PELO PROJETO MAPBIOMAS ACESSE O PAINEL DE ESTAT\u00cdSTICA DE ACUR\u00c1CIA DAS COLE\u00c7\u00d5ES A an\u00e1lise de acur\u00e1cia \u00e9 a principal forma de avalia\u00e7\u00e3o da qualidade do mapeamento realizado pelo MapBiomas. Al\u00e9m de dizer qual a taxa de acerto geral, a an\u00e1lise de acur\u00e1cia tamb\u00e9m revela estimativas das…","_links":{"self":[{"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/793"}],"collection":[{"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/comments?post=793"}],"version-history":[{"count":21,"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/793\/revisions"}],"predecessor-version":[{"id":8442,"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/pages\/793\/revisions\/8442"}],"wp:attachment":[{"href":"https:\/\/brasil.mapbiomas.org\/en\/wp-json\/wp\/v2\/media?parent=793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}