libre-service.eu/pad.libre-service.eu-etherpad
libre-service.eu/pad.libre-service.eu-etherpad
1
0
Fork 0
mirror of https://github.com/ether/etherpad-lite.git synced 2025-01-19 14:13:34 +01:00
Code Issues Projects Releases Wiki Activity

Try/catch to skip invalid JSON in dirtyDB

Browse source
This commit is contained in:
Achim Friedland 2018-11-02 20:10:36 +01:00 committed by muxator
parent 0443de4dc9
commit 5f836f6211
1 changed files with 5 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
bin/dirty-db-cleaner.py
View file

@ -31,8 +31,11 @@ with open(dirtydb_input, 'r') as fd:
print 'Reading %s' % dirtydb_input
for line in fd:
lines += 1
data = json.loads(line)
dirtydb[data['key']] = line
try:
data = json.loads(line)
dirtydb[data['key']] = line
except:
print("Skipping invalid JSON!")
if lines % 10000 == 0:
sys.stderr.write('.')
print