trdsql wildcard, compressed file
Posted on:
Wildcard
Up to this point, we have targeted one file, but log files, etc. may be rotated and become multiple files.
If the target file is composed of the same columns, you can use wildcards to treat multiple files as one table.
$ ls test*.csv
test1.csv test2.csv test3.csv
trdsql -icsv "SELECT COUNT(*) FROM test*.csv"
15
Compressed files
Old log files might be compressed. If they are compressed with [gzip, bzip2, zstd, lz4, xz], they will be automatically decompressed and processed.
trdsql -iltsv "SELECT * FROM access.log.2.gz"
You can also combine wildcards with compressed files for execution.
$ ls
access.log access.log.1 access.log.2.gz
trdsql -iltsv "SELECT * FROM access.log.*"