More Videos:

Strange Bedfellows Say Let Fannie and Freddie Live

Tickers in this article: FMCC FNMA
NEW YORK ( TheStreet) -- "I don't know whether it's Ralph moving or me moving but we're finding ourselves more and more aligned these days."

The speaker was Ted Olson, partner at Gibson, Dunn & Crutcher, former solicitor general during the George W. Bush administration, and he was referring to Ralph Nader, the occasional Presidential candidate and storied consumer advocate.

What brought them together for a panel discussion on Wednesday was a shared belief that the U.S. Treasury Department needs to recognize the rights of shareholders in government sponsored enterprises (GSEs) Fannie Mae and Freddie Mac .

Olson is representing Perry Capital, a large hedge fund, in a lawsuit against the government , while Nader is a shareholder himself , representing what he says are just regular folks, "not day traders" who relied on government assurances that Fannie and Freddie were safe investments, before the GSEs were taken under government conservatorship at the height of the financial crisis in September 2008.

The status of Fannie and Freddie shareholders "is intimately related with affordable housing goals," Nader said. "These are very delicate institutions and if you don't have a capital market you're not going to have affordable housing."

But consumer and housing advocates who also sat on the panel seemed to have little interest in what happens to common and preferred shareholders in the GSEs.

"It's high cotton for me," said John Taylor, President and CEO of the nonprofit National Community Reinvestment Coalition, which seeks to "increase the flow of private capital into traditionally underserved communities," according to its website. "I'm not a hedge fund guy. They have their fight and they have their lawyers."

Taylor claims his only interest is enabling middle and working class people to afford homes, but "it looks like preserving Fannie and Freddie is the most likely scenario in which that outcome will come to [pass]," he said in a follow-up interview after the panel discussion.

Many hedge fund investors will presumably like the sound of this. Michael Kao of Akanthos Capital , for example, has been advocating for a return of Fannie and Freddie to the private markets for more than three years

But there is a point where the interests of shareholders and housing advocates diverge. For example, another nonprofit called the National Low Income Housing Coalition (NLHC) filed a lawsuit against the Federal Housing Finance Authority, which oversees the GSEs, arguing the FHFA failed to live up to obligations to pay into a National Housing Trust Fund and a Capital Magnet Fund

"The obligation to fund the Housing Trust Fund and the Capital Magnet Fund precedes other claims," said Sheila Crowley, President and CEO of the NLHC. Speaking on Wednesday's panel, Crowley said her group is looking for $500 million to $1 billion for the funds, which would be "the first new money to go into housing for poor people in a very very very long time."