The Socialist leader passed away at Fortis Gurugram on Thursday evening as per the statement of hospital's media chief.
The leader was 75 years old and is survived by his wife, a daughter, and a son.
In a political carrier of nearly 5 decades, Sharad Yadav has been a Union minister, chief of the Janata Dal United, and convenor for the National Democratic Alliance.
Sharad Yadav was ailing from kidney-related issues for a long time and regularly underwent dialysis.
Prime Minister Narendra Modi tweeted condolence, “Pained by the passing away of Shri Sharad Yadav Ji. He was greatly inspired by Dr. Lohia’s ideals".