Keep all INDIVIDUAL kubeconfig.yaml files under .kube/contexts
Then put the following line in your .bashrc
(Linux) or .bash_profile
(MacOS)
export KUBECONFIG=$(for YAML in $(find ${HOME}/.kube/contexts -name '*.yaml') ; do echo -n ":${YAML}"; done)