python 数据筛选

有这样一个列表：

L1 = ["SELECT A,B FROM T1 WHERE A = 'AAA' AND B=1 AND C<=TO_DATE('2018-08-30',YYYY-MM-DD)",
      "SELECT A,B FROM T1 WHERE A = 'BBB' AND B=2 AND C<=TO_DATE('2018-08-21',YYYY-MM-DD)",
      "SELECT A,B FROM T1 WHERE A = 'CCC' AND B=3 AND C<=TO_DATE('2018-08-10',YYYY-MM-DD)",
      "SELECT C,D FROM T2 WHERE C = 'JJJ' AND D=4 AND E>=TO_DATE('2018-07-30',YYYY-MM-DD)",
      "SELECT C,D FROM T2 WHERE C = 'KKK' AND D=5 AND E>=TO_DATE('2018-05-30',YYYY-MM-DD)"]

--需要将L1进行处理，类似的语句只保留一条，最终结果保留2条,类似如下:
L1 = ["SELECT A,B FROM T1 WHERE A = 'AAA' AND B=1 AND C<=TO_DATE('2018-08-30',YYYY-MM-DD)",
      "SELECT C,D FROM T2 WHERE C = 'JJJ' AND D=4 AND E>=TO_DATE('2018-07-30',YYYY-MM-DD)"]

跪求各位大神解答~~~~~

求大神解答呀

简单点就是匹配前多少个字符, 复杂点就用相似度匹配.
L1 = ["SELECT A,B FROM T1 WHERE A = 'AAA' AND B=1 AND C<=TO_DATE('2018-08-30',YYYY-MM-DD)",
      "SELECT A,B FROM T1 WHERE A = 'BBB' AND B=2 AND C<=TO_DATE('2018-08-21',YYYY-MM-DD)",
      "SELECT A,B FROM T1 WHERE A = 'CCC' AND B=3 AND C<=TO_DATE('2018-08-10',YYYY-MM-DD)",
      "SELECT C,D FROM T2 WHERE C = 'JJJ' AND D=4 AND E>=TO_DATE('2018-07-30',YYYY-MM-DD)",
      "SELECT C,D FROM T2 WHERE C = 'KKK' AND D=5 AND E>=TO_DATE('2018-05-30',YYYY-MM-DD)"]
L2 = []
check_size = 20
checked = []
for s in L1:
    if not L2:
        L2.append(s)
        checked.append(s[:check_size])
        continue

    if s.startswith(tuple(checked)):
        continue

    L2.append(s)
    checked.append(s[:check_size])

lixxu 发表于 2018-9-6 08:23
简单点就是匹配前多少个字符, 复杂点就用相似度匹配.
L1 = ["SELECT A,B FROM T1 WHERE A = 'AAA' AND B=1  ...

谢谢大神，可能我是要弄复杂点的相似度匹配，只匹配前多少个字符在我模拟的数据里面可以的，但我实际要处理的数据可能语句长短不一，所以估计无法满足需求哟