You'll be able to do it.
Like most computer skills, writing code has an extremely low entry barrier.
The problem is that to become a true hacker (in the good sense) takes a extremely long time, a lot of knowledge, the right mindset, and a heap of natural talent. Low entry barrier, high mastery barrier.
I can't pretend to be very good.
The connection between maths and code is not in mathematics itself, it's in the logic behind it.
Programming software is an engineering discipline; it _requires_ the ability to keep in mind entire systems while focusing at the same time on a microscopic level -- the instructions you will give to the computer are by necessity explicitly detailed, as is always the case when working with what is fundamentally a pattern machine.
The only time you'll need real math is when you're dealing with purpose-built software: 3-D code and statistics apps, and of course when you write code to solve your calculus homework and print the steps.
If you feel that you're strong conceptually in maths, you'll have no problem. But if you memorize to pass, you might have an issue.
Many say (IMO rightly so) that some people cannot program.
I believe to be a decent programmer you have to have a certain mindset -- once again, very conceptually strong, logical, because your code is a layer of indirection, an abstraction. Some think that most programmers are pedants, but that's okay.
But I think that if you have the initiative to learn, that's a good sign. By all means, I suggest that you should try it, at least. Everyone should.
For me, it was fun _immediately_.
I write code almost professionally, generally getting work (freelancing and contractual) by word-of-mouth and by those using or examining my own side projects...
So, I recommend that you _do_ learn. If you don't like it, you'll never use it.
--
What language you use depends so much on what you want to do with your programs.
From a purely didactic standpoint, I would suggest C++ as a first language, and I've got a developed rationale for that.
I suggest that you edit your question to specify what you hope to create, so we can maybe point you in the right direction...
Please realize immediately that there is nothing that you can do with C++ that you can't with Haskell, or with JavaScript: they're all equally capable in their domain. But as tools, they can be better suited for one problem than another:
I would rather use Haskell for symbolically evaluating very complicated mathematics, but I would rather use C++ for 3D, and Python for UI design, and fast and easy stuff... It all depends on what you want to do.
Good luck.