X-Factor Investigations was founded as a detective agency run by Jamie Madrox, a.k.a. the Multiple Man, a mutant with self-replication abilities. Using his connections to FBI, Madrox became a licensed detective and established an office in District X, the neighborhood known as Mutant Town. The agency was initially named "XXX Investigations".
