Assumes you are using Visual Studio:
Typically for services in the past I have had other devs set up 'Build Events' that ensure that certain things in the project get built. Typically it would be in ASP.NET project properties for Visual Studio 2015 as an example: >'Build Events'(left pane)>Click 'Edit Post-build'. Write in command line instructions of how the project should build to output. EG:
mkdir "$(ProjectDir)bin\Setup"
create a directory under bin called 'Setup'
Del "$(ProjectDir)bin\Setup\*.* /Q"
Deletes any existing items in the newly created bin
copy "$(TargetDir)*.dll" "$(ProjectDir)bin\Setup"
Copies dll's from build location to the new setup location
Now if you are doing a build process where your 'Configuration Manager' is doing a different output for each environment and you just want each of them at all times you would probably need to traverse up a level, find those bins by their name of 'dev' or 'stg' and then copy them back. You may be able to create or list a variable that VS knows for the environment that matches to your JSON data as well.