Simply put, a PSU (also known as a Power Supply Unit) supplies power to the various different components in a PC.
Anything that requires power in order to function will directly connect to the PSU or will connect to the motherboard, which is also connected to the PSU.
Without a PSU, the computer will not be able to run, and getting a good one is important to reduce the risk of damage to your components.
Each PSU will come with a power rating for a certain amount of watts, which I will cover in a sec. But just know the higher the wattage, the more power the PSU can supply.
There are 3 main types of PSU, however, most of these differences are purely cosmetic, and will not generally have an impact on the power supplied.
(special thanks to CGDirector for the diagram)
Firstly, there is the Non-modular PSUs. As the name suggests, these come pre-installed with a certain number of cables already attached, and no open spots for any new cables.
These PSUs are generally best for those unfamiliar with computers, or those who know that upgrades are not for them.
Secondly, there are the Semi-modular PSUs. These PSUs come with a few cables preinstalled, such as a GPU connector, Motherboard connector, etc. However, some of the time, you can remove the GPU connector to only have a motherboard connector on the PSU.
These allow for greater customisation and are for those generally looking out for the aesthetic of the PC.
Finally, we have the fully modular PSUs. As the name suggests, you are able to fully customise the cables on the PSU for whatever you need. If you have a certain component that needs power, thats not standard, you can use a fully modular PSU to get it connected.
These PSUs are for enthusiast tier users who want to be able to fully customise what they include in their PC, and hence are not recommended for newer users.
PSUs are pretty common, and most tech retailers will sell them. The big thing about a PSU is the wattage. If your PC has a certain wattage requirement, then you need a PSU that at least meets that requirement. My tip is to buy a PSU last, and look up each components wattage, add them together and find a PSU greater than that number. This reduces the risk of your components running slower than expected, as they do not have the power needed to run at their full potential. Here are some recommended sites to buy PSUs