API structures don't take config pointers

This means they can't be informed on changes to the config later which right now means changes in debug mode. There is no reason that we need to create the API structure before loading and parsing a config so if we just use a pointer we should be able to solve this problem.

Or we can change the calling convention and have config passed in as well like we do with commands.