This is for a Raspberry 3 running Rasbian that I wrote but should be the same, ignore the parts about the SD Card if not relevant:
Buy a Raspberry 3, microusb power supply, case, and 16GB Class 10 MicroSD card.
On a Windows desktop:
Download Raspbian Jessie Lite here...