Optimize pipeline to use configurations from json/yaml files

[hillaryke]

• Use YAML file due to it being human readable
• Use Multiple files for different configurations for easy and individual management