There are a lot of things brought to mind when you want to create a programming language. First of all please understand that it is not a one person job. The first an foremost thing you have to keep in mind when you want to create a PL is the structure of a compiler. That include concepts like
1. Lexical Analysis
2. Syntax Analysis
3. Semantic Analysis
4. Parsing
5. Intermediate Code generation
6. Code optimization
7. Actual code generation
8. Symbol table management
9. The grouping of phrases into passes
10. Compiler Construction tools
(these are various steps through which a compiler understands a code language)
Then you have to know all the algorithms of Greedy method, dynamic programming etc, that will help you in memory management and problem solving.
For code generation, you have to know assembly language, and intermediate code.
Start reading a textbook on Principles of programming languages and Compiler Designs and it will lead you to what you should do next.
All the best :) hope this helps :)