Nvidia shares fell about 6% in premarket trading on Thursday as investors weighed whether the company's board would remove CEO Jensen Huang. CNBC confirmed that the board met on Wednesday to discuss whether to oust him.

The pressure follows reports of two extramarital relationships. Huang admitted on Sunday to having an affair with Alice Huang, an executive at cloud company Megaspeed, according to The Financial Times. The Financial Times reported that U.S. intelligence officials believe Alice Huang is a spy for China. The New York Times reported on Wednesday that Huang had another relationship, with Kimberly Powell, Nvidia's vice president of health care. The Times said Powell reports to Huang.

Several Wall Street analysts told CNBC that Nvidia could fall 20% if Huang leaves. Nvidia's stock was already down more than 20% over the last month. Bernstein cut its price target on Nvidia from $400 to $200. Bernstein analyst Stacy Rasgon told CNBC that the alleged affair with a direct report makes it "much tougher for the board to leave him in position."

U.S. lawmakers have called for Huang's resignation, according to the report. Richard Reyle, chief investment officer at Questar Capital Partners, told CNBC that Nvidia's lack of a succession plan makes the stock "uninvestable." Rasgon said it is unclear who could lead the company as its next CEO.

Shares of rivals AMD and Broadcom rose 3.9% and 3% in premarket trading. Intel, Marvell, Arm and Qualcomm traded lower.