President Donald Trump said that the Treasury Department or other agencies could potentially take over administering student loans if his administration were to abolish the Education Department, which currently oversees the issue.

“That’ll be brought into either Treasury or Small Business Administration or Commerce. And we actually had that discussion today,” Trump told reporters Thursday in the Oval Office.