用空格分割行，但保留反引号内的字符串

Question

我有以下格式化数据：

testing 25 `this is a test`
hello `world hello world`
log "log1" "log2" `third log`

我目前正在使用正则表达式和shlex的组合，但我遇到了问题，如上所示

import re, shlex

def tokenize(line):
    graveKeyPattern = re.compile(r'^ *(.*) (`.*`) *')
    if '`' in line:
        tokens = re.split(graveKeyPattern, line)
        tokens = tokens[1:3]
    else:
        tokens = shlex.split(line)
    #end if/else
    print(tokens)
    return tokens
#end tokenize

lines = []
lines.append('testing 25 `this is a test`')
lines.append('hello `world hello world`')
lines.append('log "log1" "log2" `third log`')
lines.append('testing2 "testing2 in quotes" 5')

for line in lines:
    tokenize(line)

这是我得到的输出：

['testing 25', '`this is a test`']
['hello', '`world hello world`']
['log "log1" "log2"', '`third log`']
['testing2', 'testing2', 'in', 'quotes', '5']

这是我需要的输出：

['testing', '25', '`this is a test`']
['hello', '`world hello world`']
['log', 'log1', 'log2', '`third log`']
['testing2', 'testing2 in quotes', '5']

Answer 1

有时，匹配你想要的比分割你不想要的更容易。

通过匹配反引号或非空格/引号之间的内容，这适用于您的测试：

lines = []
lines.append('testing 25 `this is a test`')
lines.append('`world hello world` hello ')
lines.append('log "log1" "log2" `third log` log3')

import re
[re.findall(r'((?:`.*?`)|[^\"\s]+)', s) for s in lines]

结果

[['testing', '25', '`this is a test`'],
 ['`world hello world`', 'hello'],
 ['log', 'log1', 'log2', '`third log`', 'log3']]