The deceased are seven-month-old Anjal BK and eight-month-old Krishna BK of Tolijaisi-8.
Local social worker Rakshya Bahadur Sahi said that the infants died while receiving treatment at a local health facility.
Chief at Primary Health Center Dr Bikash Shah said two others have been referred to Nepalgunj for further treatment.
Acting Chief at District Health Office, Nirmal Rasaili said that health teams have been sent to the affected area with medicines.
2100 undergo free heart check-up in health camp