Buildings play a major role in climate plans and decarbonization. A major component of decarbonization plans is building electrification which involves electrification of heating in buildings. The electrifying heating system that is widely explored and is being implemented throughout the United States switches heating systems from fossil fuel furnaces, most commonly using natural gas, to heat pumps. It is known that the coefficient of performance (COP) of heat pumps is a function of outdoor air temperature and therefore a function of regional climate and building location. However, there has not been a study that looks at the emission footprint of heat pumps in comparison to natural gas in different locations considering the local grid emission rates. The objective of this study is to investigate the location-specific emissions footprint of heat pumps versus natural gas furnaces. To quantify the emission footprint, we use the emissions data from the EPA Emissions & Generation Resource Integrated Database (eGRID). Results show that while heat pumps with high COPs can help save energy and reduce emissions, the emission footprint of heat pumps varies for different locations based on the climate as well as the emission rate of the local grid. This study produces results that can be used as a guide to identify the location-specific heat pumps that can provide emission reduction co-benefits compared to a natural gas furnace. For example, the plots show that, in the NPCC Upstate NY eGRID subregion (electricity provided to New York) of the United States, a COP of 2 heat pump using its annual emission rate produces less emissions than a natural gas furnace with an AFUE of 0.95. On the other hand, the findings emphasize the role of the grid. The HICC Oahu eGRID subregion has the highest annual emission rate and therefore the dirtiest grid, so a heat pump with COP of 2 would produce more emissions than the natural gas furnace. Therefore, with the current grid emission rates in this region, a higher COP (~>4) is needed for heat pumps to have emission reduction benefits. Furthermore, with decarbonizing the grid and having a cleaner delivered electricity in the future, heat pumps will have even higher emission reductions. Using this guide to aid the implementation of location-appropriate heat pump systems helps aid the electrification of heating that results in the reduction of emissions into the atmosphere.