数据处理（串口解析 0D 0A结尾）"/>
【GUI】基于Python的文本数据处理（串口解析 0D 0A结尾）
【GUI】基于Python的文本数据处理（串口解析 0D 0A结尾）
文章目录
- 串口处理
- 附录：列表的赋值类型和py打包
- 列表赋值
- BUG复现
- 代码改进
- 优化
- 总结
- py打包
串口处理
如有串口数据：
[37;22mD/NO_TAG [2023-04-24 23:01:06 ] ------------------------------------------------->>>>>> M_DADAT_GET_DAMAGE_INFO
[0m
2023/04/24 23:01:06 m_radar_parse_msg: 0000-000F: 23 55 00 85 52 01 42 04 00 00 00 D9 FD A5 02 00
2023/04/24 23:01:06 m_radar_parse_msg: 0010-001F: 00 89 FD 68 0A DA FF C1 FD 19 03 00 00 71 FD 95
2023/04/24 23:01:06 m_radar_parse_msg: 0020-002F: 05 66 FF F8 FD F2 FD 00 00 A8 FD C9 0E C6 01 D7
2023/04/24 23:01:06 m_radar_parse_msg: 0030-003F: FD B1 02 00 00 87 FD 5E 09 CA FF DB FD B4 02 00
2023/04/24 23:01:06 m_radar_parse_msg: 0040-004F: 00 8B FD DA 0B BE FF 00 00 00 00 00 00 00 00 00
2023/04/24 23:01:06 m_radar_parse_msg: 0050-005F: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
要求提取m_radar_parse_msg后的内容；
# -*- coding: utf-8 -*-
"""
Created on Fri Apr 28 09:26:36 2023@author: ZHOU
"""
import redef new_judg(s):if s[-5]+s[-4]+s[-3]+s[-2]+s[-1]=="0D 0A":s=s+'\n'return s
path = "m_radar_parse_msg.txt"
output_path="out_m_radar_parse_msg.txt"
f=open(path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
try:f=open(output_path, 'w', encoding="utf-8")
except:f=open(output_path, 'a', encoding="utf-8")
for i in f_list:try:s=i.split('m_radar_parse_msg: ')[1]s=s.split('\n')[0]s=s.split(': ')[1]s=s.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)f.write(new_judg(s))except:passf.close()f=open(output_path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
f=open(output_path, 'w', encoding="utf-8")
for i in f_list:s=i.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)f.write(s)
f.close()输出结果：
同样的：
2023-04-25 13:37:27.983 3304 7031 D #ST2303_STI1#: [(I1CommunicationHandler.java:1079)#postSensorReport] 雷达请求主动拍摄照片
2023-04-25 13:37:27.984 3391 3852 V #ST2303_sensor#: [(LDCJOneSensor.java:207)#run] wirte package len = 11
2023-04-25 13:37:27.986 3304 7031 I #ST2303_STI1#: [(I1CommunicationHandler.java:1084)#postSensorReport] 拍照间隔不到60秒，不拍！
2023-04-25 13:37:27.986 3391 3852 V #ST2303_sensor#: [(LDCJOneSensor.java:215)#run] 收状态
2023-04-25 13:37:28.028 3391 3853 V #ST2303_sensor#: [(LDCJOneSensor.java:306)#run] ldcj mReadRunnable read returned 108
2023-04-25 13:37:28.031 3391 3853 I #ST2303_sensor#: [(Utils.java:412)#printSerialData] 23 55 01 01 52 01 49 00 00 e2 ff 32 00 a0 00 b6 00 70 00 50 00 78 00 78 00 f8 11 00 00 eb 07 eb 07 10 05 cc 03 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 04 00 20 0a 98 07 91 01 00 00 4b ff 36 08 3e ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2023-04-25 13:37:28.033 3391 3853 V #ST2303_sensor#: [(LDCJOneSensor.java:413)#fetchPacket] buffer start:0, end:0
2023-04-25 13:37:28.034 3391 3853 V #ST2303_sensor#: [(LDCJOneSensor.java:306)#run] ldcj mReadRunnable read returned 84
2023-04-25 13:37:28.036 3391 3853 I #ST2303_sensor#: [(Utils.java:412)#printSerialData] f1 00 c7 2c d6 15 aa 09 d9 00 a7 88 fe 6e e5 92 fe 68 c5 10 e2 00 9a 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00则采用printSerialData：
# -*- coding: utf-8 -*-
"""
Created on Fri Apr 28 09:26:36 2023@author: ZHOU
"""
import redef new_judg(s):if s[-5]+s[-4]+s[-3]+s[-2]+s[-1]=="0D 0A":s=s+'\n'return spath = "printSerialData.txt"
output_path="out_printSerialData.txt"
f=open(path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
try:f=open(output_path, 'w', encoding="utf-8")
except:f=open(output_path, 'a', encoding="utf-8")
for i in f_list:try:s=i.split("#printSerialData] ")[1]s=s.split('\n')[0]s=s.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s) f.write(new_judg(s))except:passf.close()f=open(output_path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
f=open(output_path, 'w', encoding="utf-8")
for i in f_list:s=i.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)f.write(s)
f.close()
还有radarOriginDataHexString：
{"damageCount":0,"damagePointInfoList":[],"originDataLength":1744,"radarFirmwareVersion":"1887f73","radarOriginDataHexString":"235500855201420100000000000000000024001B00C0FF000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000003910D0A235501015201490000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800738040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001D90D0A23550291520100000000000000087D0000000100020000F2011000D756C0004D2202B88006CB36000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000003F8000003D76C47043C000004179EC46000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000D1B0D0A23550291520101000000000000087C0000000100020000BF010300F253C00046EC02837FFACD10000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000003F8000003D76C47043C000004179EC46000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000E500D0A"}
# -*- coding: utf-8 -*-
"""
Created on Fri Apr 28 09:26:36 2023@author: ZHOU
"""import redef new_judg(s):if s[-5]+s[-4]+s[-3]+s[-2]+s[-1]=="0D 0A":s=s+'\n'return s
path = "radarOriginDataHexString.txt"
output_path="out_radarOriginDataHexString.txt"
f=open(path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
try:f=open(output_path, 'w', encoding="utf-8")
except:f=open(output_path, 'a', encoding="utf-8")
for i in f_list:try:s=i.split('radarOriginDataHexString":"')[1]s=s.split('"}')[0]s=s.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)f.write(new_judg(s))except:passf.close()f=open(output_path, 'r', encoding="utf-8")
f_list=f.readlines()
f.close()
f=open(output_path, 'w', encoding="utf-8")
for i in f_list:s=i.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)f.write(s)
f.close()
整合起来：
# -*- coding: utf-8 -*-
"""
Created on Fri Apr 28 10:39:48 2023@author: ZHOU
"""import tkinter as tk # 调用窗口tk
from tkinter import ttk
from tkinter.filedialog import askopenfilename
import tkinter.messagebox
import os # 调用os多操作系统接口库
import re
import threading # 调用threading多线程运行库
import time
key_list = ['m_radar_parse_msg','radarOriginDataHexString','printSerialData']
def new_judg(s):try:strings=s[-5]+s[-4]+s[-3]+s[-2]+s[-1]if strings=="0D 0A" or strings=="0d 0a":s=s+'\n'else:s=s+' 'except:s=s+' 'return sdef ctrl_str(s,key):if key==key_list[0]:s=s.split('m_radar_parse_msg: ')[1]s=s.split('\n')[0]s=s.split(': ')[1]elif key==key_list[1]:s=s.split('radarOriginDataHexString":"')[1]s=s.split('"}')[0]elif key==key_list[2]:s=s.split("#printSerialData] ")[1]s=s.split('\n')[0]else:s=s.split('\n')[0]s=s.replace(' ', '')s=re.sub(r"(?<=\w)(?=(?:\w\w)+$)", " ", s)s=new_judg(s)return sdef ctrl_txt(path,key):dir_path=os.path.split(path)[0]output_path=os.path.join(dir_path,'out_'+str(key)+'.txt') try:f=open(path, 'r', encoding="utf-8")except:return f_list=f.readlines()
# f_len=len(f_list)
# j=0f.close()try:f=open(output_path, 'w', encoding="utf-8") except:try:f=open(output_path, 'a', encoding="utf-8")except:return for i in f_list:
# j=j+1
# print("写入数据进度: "+str(j)+"/"+str(f_len)+" "+str(int(j/f_len*100))+"%")try: s=ctrl_str(i,key)f.write(s)except:passf.close()return output_path def central_win(win):win.resizable(0,0) # 不可缩放screenwidth = win.winfo_screenwidth() # 获取屏幕分辨率宽screenheight = win.winfo_screenheight() # 获取屏幕分辨率高win.update() # 更新窗口width = win.winfo_width() # 重新赋值height = win.winfo_height()size = '+%d+%d' % ((screenwidth - width)/2, (screenheight - height)/2)# 重新赋值大小 大小为屏幕大小/2win.geometry(size) # 以新大小定义窗口def gui_start(): gui=tk.Tk()gui.title("txt串口数据处理")gui.attributes('-topmost',0)guifram=tk.Frame(gui,width=880, height=300)guifram.grid_propagate(0)guifram.grid()central_win(gui)labelName=tkinter.Label(gui, text='选择数据类型:', justify=tkinter.LEFT)labelName.place(x=40, y=20, width=200, height=40)labelName=tkinter.Label(gui, text='选择文件路径:', justify=tkinter.LEFT)labelName.place(x=40, y=60, width=200, height=40)labelName=tkinter.Label(gui, text='数据过多需要一定时间才能解析 解析完成前请勿关闭主界面', justify=tkinter.LEFT)labelName.place(x=240, y=120, width=400, height=40)s0 = ttk.Combobox(guifram)s0['value'] = key_lists0['state'] = 'read-write's0.delete(0, tk.END) # 将输入框里面的内容清空s0.insert(0, key_list[0])s0.place(x=240, y=20, width=400, height=40)s1 = ttk.Entry(guifram)s1.delete(0, tk.END) # 将输入框里面的内容清空s1['state'] = 'read-write's1.place(x=240, y=60, width=400, height=40)filetype_list=[("文本文件","*.txt")]def filefound():filepath= askopenfilename(filetype=filetype_list)print (filepath)s1.delete(0, tk.END) # 将输入框里面的内容清空s1.insert(0, filepath)def txt():path=str(s1.get())key=str(s0.get())if os.path.exists(path) and key!='':ti=time.time()output_path=ctrl_txt(path,key)print(output_path)if output_path:tk.messagebox.showinfo('解析已完成', "文件保存路径:\n"+output_path+"\n耗时:\n"+str(time.time()-ti))else:tk.messagebox.showinfo('关键词格式错误','关键词格式错误')return tk.messagebox.showinfo('文件不存在', "文件路径:\n"+path)def doing_txt():t=threading.Thread(target=txt)t.setDaemon(True)t.start()tk.Button(guifram,text="选择文件",command=filefound).place(x=640, y=60, width=200, height=40) tk.Button(guifram,text="开始解析",command=doing_txt).place(x=240, y=160, width=400, height=40)gui.mainloop()if __name__ == '__main__':gui_start()
附录：列表的赋值类型和py打包
列表赋值
BUG复现
闲来无事写了个小程序 代码如下：
# -*- coding: utf-8 -*-
"""
Created on Fri Nov 19 19:47:01 2021@author: 16016
"""a_list = ['0','1','2','3','4','5','6','7','8','9','10','11','12','13','14','15']
#print(len(a_list))
#b_list = ['','','','','','','','','','','','','','','','']
c_list = [[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]]
#for i in range(16):
if len(a_list):for j in range(16):a_list[j]=str(a_list[j])+'_'+str(j)print("序号:",j)print('a_list:\n',a_list)c_list[j]=a_listprint('c_list[0]:\n',c_list[0])print('\n')
# b_list[j]=a_list[7],a_list[8]
# print(b_list[j])# 写入到Excel：
#print(c_list,'\n')
我在程序中 做了一个16次的for循环 把列表a的每个值后面依次加上"_"和循环序号
比如循环第x次 就是把第x位加上_x 这一位变成x_x 我在输出测试中 列表a的每一次输出也是对的
循环16次后列表a应该变成[‘0_0’, ‘1_1’, ‘2_2’, ‘3_3’, ‘4_4’, ‘5_5’, ‘6_6’, ‘7_7’, ‘8_8’, ‘9_9’, ‘10_10’, ‘11_11’, ‘12_12’, ‘13_13’, ‘14_14’, ‘15_15’] 这也是对的
同时 我将每一次循环时列表a的值 写入到空列表c中 比如第x次循环 就是把更改以后的列表a的值 写入到列表c的第x位
第0次循环后 c[0]的值应该是[‘0_0’, ‘1’, ‘2’, ‘3’, ‘4’, ‘5’, ‘6’, ‘7’, ‘8’, ‘9’, ‘10’, ‘11’, ‘12’, ‘13’, ‘14’, ‘15’] 这也是对的
但是在第1次循环以后 c[0]的值就一直在变 变成了c[x]的值
相当于把c_list[0]变成了c_list[1]…以此类推 最后得出的列表c的值也是每一项完全一样
我不明白这是怎么回事
我的c[0]只在第0次循环时被赋值了 但是后面它的值跟着在改变
如图：
第一次老出bug 赋值以后 每次循环都改变c[0]的值 搞了半天都没搞出来
无论是用appen函数添加 还是用二维数组定义 或者增加第三个空数组来过渡 都无法解决
代码改进
后来在我华科同学的指导下 突然想到赋值可以赋的是个地址 地址里面的值一直变化 导致赋值也一直变化 于是用第二张图的循环套循环深度复制实现了
代码如下：
# -*- coding: utf-8 -*-
"""
Created on Fri Nov 19 19:47:01 2021@author: 16016
"""a_list = ['0','1','2','3','4','5','6','7','8','9','10','11','12','13','14','15']
#print(len(a_list))
#b_list = ['','','','','','','','','','','','','','','','']
c_list = [[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]]
#for i in range(16):
if len(a_list):for j in range(16):a_list[j]=str(a_list[j])+'_'+str(j)print("序号:",j)print('a_list:\n',a_list)for i in range(16):c_list[j].append(a_list[i])print('c_list[0]:\n',c_list[0])print('\n')
# b_list[j]=a_list[7],a_list[8]
# print(b_list[j])# 写入到Excel：
print(c_list,'\n')
解决了问题
优化
第三次是请教了老师 用copy函数来赋真值
代码如下：
# -*- coding: utf-8 -*-
"""
Created on Fri Nov 19 19:47:01 2021@author: 16016
"""a_list = ['0','1','2','3','4','5','6','7','8','9','10','11','12','13','14','15']
#print(len(a_list))
#b_list = ['','','','','','','','','','','','','','','','']
c_list = [[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]]
#for i in range(16):
if len(a_list):for j in range(16):a_list[j]=str(a_list[j])+'_'+str(j)print("序号:",j)print('a_list:\n',a_list)c_list[j]=a_list.copy()print('c_list[0]:\n',c_list[0])print('\n')
# b_list[j]=a_list[7],a_list[8]
# print(b_list[j])# 写入到Excel：
#print(c_list,'\n')
同样能解决问题
最后得出问题 就是指针惹的祸！
a_list指向的是个地址 而不是值 a_list[i]指向的才是单个的值 copy()函数也是复制值而不是地址
如果这个用C语言来写 就直观一些了 难怪C语言是基础 光学Python不学C 遇到这样的问题就解决不了
C语言yyds Python是什么垃圾弱智语言
总结
由于Python无法单独定义一个值为指针或者独立的值 所以只能用列表来传送
只要赋值是指向一个列表整体的 那么就是指向的一个指针内存地址 解决方法只有一个 那就是将每个值深度复制赋值（子列表内的元素提取出来重新依次连接） 或者用copy函数单独赋值
如图测试：
部分代码：
# -*- coding: utf-8 -*-
"""
Created on Sat Nov 20 16:45:48 2021@author: 16016
"""def text1():A=[1,2,3]B=[[],[],[]]for i in range(len(A)):A[i]=A[i]+iB[i]=Aprint(B)def text2():A=[1,2,3]B=[[],[],[]]A[0]=A[0]+0B[0]=Aprint(B)A[1]=A[1]+1B[1]=Aprint(B)A[2]=A[2]+2B[2]=Aprint(B)if __name__ == '__main__':text1()print('\n')text2()
py打包
Pyinstaller打包exe（包括打包资源文件 绝不出错版）
依赖包及其对应的版本号
PyQt5 5.10.1
PyQt5-Qt5 5.15.2
PyQt5-sip 12.9.0
pyinstaller 4.5.1
pyinstaller-hooks-contrib 2021.3
Pyinstaller -F setup.py 打包exe
Pyinstaller -F -w setup.py 不带控制台的打包
Pyinstaller -F -i xx.ico setup.py 打包指定exe图标打包
打包exe参数说明：
-F：打包后只生成单个exe格式文件；
-D：默认选项，创建一个目录，包含exe文件以及大量依赖文件；
-c：默认选项，使用控制台(就是类似cmd的黑框)；
-w：不使用控制台；
-p：添加搜索路径，让其找到对应的库；
-i：改变生成程序的icon图标。
如果要打包资源文件
则需要对代码中的路径进行转换处理
另外要注意的是 如果要打包资源文件 则py程序里面的路径要从./xxx/yy换成xxx/yy 并且进行路径转换
但如果不打包资源文件的话 最好路径还是用作./xxx/yy 并且不进行路径转换
def get_resource_path(relative_path):if hasattr(sys, '_MEIPASS'):return os.path.join(sys._MEIPASS, relative_path)return os.path.join(os.path.abspath("."), relative_path)而后再spec文件中的datas部分加入目录
如：
a = Analysis(['cxk.py'],pathex=['D:\\Python Test\\cxk'],binaries=[],datas=[('root','root')],hiddenimports=[],hookspath=[],hooksconfig={},runtime_hooks=[],excludes=[],win_no_prefer_redirects=False,win_private_assemblies=False,cipher=block_cipher,noarchive=False)
而后直接Pyinstaller -F setup.spec即可
如果打包的文件过大则更改spec文件中的excludes 把不需要的库写进去（但是已经在环境中安装了的）就行
这些不要了的库在上一次编译时的shell里面输出
比如：
然后用pyinstaller --clean -F 某某.spec
更多推荐
【GUI】基于Python的文本数据处理（串口解析 0D 0A结尾）
发布评论