It was founded in 1937 to honor Nogi Maresuke (1849 - 1912) and his wife. Nogi was a top general of the Japanese Imperial Army who fought through numerous wars, namely civil wars which broke out when the feudal times ended, First Sino-Japanese War, and Russo-Japanese War. He was known for samurai-like ethics, and when Emperor Meiji died, he commited suicide by harakiri with his wife.

Though its shrine complex was burned down in WWII, it was rebuilt in a new design by Oe Hiroshi, an architect famous in Japan, in 1962.

Nogi Shrine is located in front of Tokyo Metro Chiyoda Line Nogizaka Station, and a 5-min walk from Roppongi Station of the Tokyo Metro Hibiya Line or Toei Oedo Line.