Just make sure you are up to the "total commitment": expenses, suitable (weather included) living conditions, waste management and total care of the horse, meaning health from tip of the ears to the bottom of the hooves. Tack that fits the horse and the tools to keep the horse groomed. Not to mention, appropriate cloths/boots to wear. It's not just buy it/ride it, your whole world is going to change and quickly!
You also might consider working at a barn and taking care of horses to see if you still want to get a horse after all the work.