stdio is a library for input and output. It has nothing to do with closing programs. exit is in stdlib header. There is no reason not to include it. You are not restricted to one header. Just look at the example on that page. It uses both stdio and stdlib.
Alternatively, returning in main() exits the program without using any libraries. Though in reality it does exactly what exit().