Keeping quotes from std out for passing to bash

Question

Okay, this is a bit convoluted but I've got a python script that digests a json file and prints a string representation of that file like so

for id in pwds.keys():
    secret += f"\'{id}\' : \'{pwds[id]['username']},{pwds[id]['pswd']}\',"
secret = secret[:-1] + "}\'"

print(secret)

This is taken in by a jenkins pipeline so it can be passed to a bash script

def secret_string = sh (script: "python3 syncToSecrets.py", returnStdout: true)
sh label: 'SYNC', script: "bash sync.sh  ${ENVIRONMENT} ${secret_string}"

I can see that when python is printing the output it looks like

'{"key" : "value", "key" : "value"...}' But when it gets to secret_string, and also the bash script it then looks like {key : value, key : value}

This is how the bash script is calling it

ENV=$1; SECRET_STRING=$2;
aws secretsmanager create-secret --name NAME --secret-string "${SECRET_STRING}"

Which technically works, it just uploads the whole thing as a string instead of discrete KV-pairs.

I'm trying to run some stuff with the AWS CLI, and it requires that the data be wrapped in quotes, but so far, I've been totally unable to keep the quotes in between processes. Any advice?

Answer 1

Sample pwds dict data:

import json

pwds = {
    'id001': {
        'username': 'user001',
        'pswd': 'pwd123'
    },
    'id002': {
        'username': 'user002',
        'pswd': 'pwd123'
    }    
}

As suggested by SuperStormer, it's a better to use Python types (dict, list, etc) instead of building your own JSON.

secrets = [{id: f"{val['username']}, {val['pswd']}"} for id, val in pwds.items()]
json.dumps(secrets)

'[{"id001": "user001, pwd123"}, {"id002": "user002, pwd123"}]'

The JSON string should be usable within Jenkins script blocks. Try experimenting with single quotes or --secret-string file://secrets.json as alternatives.