'How to split a YAML into multiple files with a proper name
I have a valid YAML:
---
name: first
metadata: a
---
name: second
metadata: b
---
name: third
metadata: c
How can I split it using a one-liner AWK script in files first.yaml, second.yaml and third.yaml? Solution needs to work with any name.
Just splitting the file works but I can't figure out how to add proper file names instead of line numbers (NR):
awk '/\-\-\-/{f=NR".yaml"}; {print >f}'
							
						Solution 1:[1]
EDIT: Adding 1 more solution.
awk '
/name:/{
  close(file)
  file=$NF".yaml"
}
file!="" && !/^--/{
  print > (file)
}
' Input_file
Could you please try following.
awk '
prev!=file{
  close(prev)
}
/name:/{
  file=$NF".yaml"
}
file!="" && !/^--/{
  print > (file)
  prev=file
}
' Input_file
Sample output file will be:
cat first.yaml
name: first
metadata: a
Explanation: Adding detailed explanation for above code.
awk '                     ##Starting awk program from here.
prev!=file{               ##Checking condition if prev is NOT equal to file variable then do following.
  close(prev)             ##Closing output file, to avoid too many files opened in back-end by mentioning close(prev) command here.
}                         ##Closing condition prev!=file here.
/name:/{                  ##Checking condition if line has string name: in it then do following.
  file=$NF".yaml"         ##Creating variable named file whose value is $NF(last field of current line) .yaml
}                         ##Closing name: condition here.
file!="" && !/^--/{       ##Checking condition if variable file is NOT NULL AND line is NOT starting with dash then do following.
  print > (file)          ##Printing current line into output file whose name is there in file variable.
  prev=file               ##Setting prev variable whose value is variable file here.
}                         ##Closing BLOCK for file!="" && !/^--/ condition here.
'  Input_file             ##Mentioning Input_file name here.
    					Solution 2:[2]
awk '/^name:/{close(out); out=$2 ".yaml"} !/^-+$/{print > out}' file
    					Solution 3:[3]
Here's another:
$ awk -v RS="---\n" 'NR>1{f=$2 ".yaml";printf "%s",$0 > f;close(f)}' file
Results:
$ cat first.yaml
name: first
metadata: a
It worked with GNU awk, mawk and busybox awk but produced a leeding empty line on awk version 20121220.
Solution 4:[4]
You can do it simply using the package yq :
yq -s '.name' file.yml 
    					Solution 5:[5]
Here is another way:
This is to address if name: is in the middle like many kubernetes yaml files.
awk '/^..name:/{file=$2 ".yaml"} !/^-/{temp=temp $0 "\n"} /^-/{print temp>file; close(file); temp=""}' inputFile
Please note, this expects the
name: to start after two spaces.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source | 
|---|---|
| Solution 1 | |
| Solution 2 | Ed Morton | 
| Solution 3 | |
| Solution 4 | PL Sergent | 
| Solution 5 | 
