-
Notifications
You must be signed in to change notification settings - Fork 2
/
bpe.vocab.src.no_nbr
19457 lines (19457 loc) · 216 KB
/
bpe.vocab.src.no_nbr
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
. 43351479
<s> 43351479
the 33425251
, 31947529
of 18732787
to 16019913
and 12351679
I 10813572
a 10643311
in 10613451
you 8577167
? 8293238
that 6454002
is 5820039
's 5752929
for 5709509
it 5198962
- 4985085
on 4862774
) 4836974
be 4723010
( 4095459
with 3753252
" 3624108
The 3584747
... 3407727
not 3245700
was 3243237
n't 3233265
! 3216783
or 3166261
this 2903376
by 2868464
are 2849272
as 2811424
You 2668745
me 2625186
have 2605617
do 2548260
at 2216567
an 2052047
from 2041687
he 1974619
It 1966562
your 1825983
my 1764336
all 1705838
we 1703484
: 1696532
No 1679202
out 1557147
What 1526815
know 1525322
which 1518621
'm 1494641
're 1493908
can 1489747
Article 1429839
what 1396793
shall 1376921
his 1372586
up 1354536
one 1337991
him 1258254
they 1241499
' 1231549
had 1220468
her 1213202
but 1204921
will 1196461
like 1171001
if 1169949
He 1165859
about 1151120
there 1148954
And 1140737
just 1133485
Commission 1128411
been 1121316
has 1100478
no 1090381
were 1086949
here 1084706
did 1066674
should 1058309
would 1054568
We 1035711
so 1025781
European 1016935
its 1010981
right 1002867
This 995980
other 963240
time 955715
In 937921
get 931213
That 913820
'll 912135
ing 911296
their 909848
Member 899383
she 877719
Regulation 861354
; 850926
could 844360
them 843311
may 842823
into 831374
re@@ 821370
any 819998
got 812457
go 802698
more 802143
us 799970
see 782360
But 778608
s 766248
A 756331
when 753332
think 743425
said 734947
who 727929
've 721099
down 709790
want 706898
than 705657
back 702346
must 700678
now 697599
only 695081
in@@ 692387
If 687043
S@@ 683541
ed 661351
es 654514
Yeah 654296
where 652110
er 633631
States 632207
C@@ 630242
under 629752
Oh 614462
take 611078
way 610843
man 600314
such 599453
some 592743
A@@ 588426
% 581574
They 580234
un@@ 574077
those 572377
B@@ 570177
So 565593
does 561154
over 555333
F@@ 550864
‘ 547300
She 545473
Well 544458
our 543285
also 539948
need 537807
good 533499
Do 530743
s@@ 526023
ation 524795
going 520495
information 519146
two 518905
– 513811
'd 510840
Union 509979
P@@ 508861
/ 507165
g@@ 506445
first 505429
G@@ 503398
these 501048
how 500939
use 499476
before 498002
then 497149
There 492011
make 488823
made 486834
EU 486292
case 485705
State 480112
Yes 473131
Council 472342
t 471895
ers 470039
How 469018
’s 467804
L@@ 461738
EC 461623
come 461346
T@@ 461345
D@@ 457331
between 456494
na 454907
e 453305
c@@ 448809
law 444274
say 436185
M@@ 435371
too 432048
something 431852
ca 430195
after 427059
H@@ 426165
new 425197
R@@ 424194
used 422521
Community 415016
ate 414652
al 412226
w@@ 411203
people 408401
measures 405925
well 405211
day 404828
tell 404468
off 404359
E@@ 403655
set 400633
order 399835
— 399797
gon 399507
Directive 397502
never 396068
very 393973
dis@@ 389205
All 388126
within 385207
Why 380929
even 379501
years 378887
t@@ 378103
b 377672
work 374110
little 373831
really 371006
through 369550
able 366983
al@@ 364754
Hey 362311
’ 361538
y 360766
e@@ 359181
am 357019
b@@ 352472
aid 351112
national 349548
place 349523
en@@ 349281
Come 347679
let 346236
market 343857
still 342601
because 341576
mean 340381
i 340312
K@@ 340170
Okay 339849
For 338999
Where 338574
accordance 335393
o 334990
much 334364
same 334051
d@@ 333654
decision 333650
ated 332830
p@@ 331934
W@@ 331744
er@@ 328605
following 323602
o@@ 322194
court 322148
ro@@ 319778
g 319368
-- 319283
f@@ 318188
h@@ 318084
look 318074
thing 317875
long 315642
part 315311
My 314768
being 310493
Is 308639
ine 308429
i@@ 308360
again 308062
life 307658
th@@ 307226
each 305075
last 303823
products 303734
I@@ 301415
ic 301294
im@@ 301186
legal 301013
application 300947
O@@ 300755
N@@ 299954
an@@ 298250
” 297762
period 296788
thought 296230
led 294683
C 294446
p 294224
without 293993
Court 293195
doing 292936
“ 292331
a@@ 292188
y@@ 291887
de@@ 291464
own 289461
provided 289107
financial 289057
help 288532
particular 287789
find 287769
name 286824
Now 286413
system 285833
give 285139
data 284634
] 284497
m 283575
Annex 283346
co@@ 282347
m@@ 282184
k@@ 281967
public 280015
con@@ 278067
L 276344
As 274830
ly 274132
-@@ 274070
necessary 273962
referred 273927
rules 273404
Not 273351
ch@@ 273120
three 272967
number 272498
love 271318
why 270979
ted 270961
year 270731
le 270688
paragraph 268967
another 268819
ts 268263
When 266747
it@@ 265148
st@@ 264619
point 263525
away 263374
ad@@ 262822
around 262635
sure 260428
sh@@ 259417
at@@ 259342
Let 259129
d 258773
ent 258375
as@@ 258336
se 257498
put 257221
night 255643
l@@ 255609
ra@@ 254553
Just 253352
authorities 252908
old 252504
against 251852
V@@ 251743
le@@ 251482
less 251361
better 251245
told 251174
n 250870
ar@@ 250443
means 249807
including 248832
might 247480
end 247288
certain 246844
ations 246189
found 244857
c 244227
ses 243527
conditions 243340
se@@ 242629
l 241709
ating 240572
en 240529
anything 239989
[ 238885
.@@ 238529
taken 238422
Are 238273
services 238096
am@@ 237171
ever 235444
level 234990
Who 233610
red 233144
ting 232561
both 231999
concerned 231507
/@@ 231128
most 230852
Decision 230385
basis 228322
Your 228050
home 227379
el@@ 226233
provisions 225892
product 224861
call 224840
procedure 224835
son 224742
or@@ 224712
To 224328
age 223578
God 222510
always 221606
okay 220815
things 219486
person 218898
pro@@ 218091
Mr. 217848
talk 217778
ri@@ 217375
les 216401
di@@ 216042
k 215607
n@@ 215238
regard 215231
Look 214627
date 214431
is@@ 213905
already 211427
days 210082
J@@ 209957
available 209612
u@@ 209499
sorry 209101
Thank 209041
possible 208769
account 208647
non 208113
whether 207789
during 207170
Then 206754
left 205737
third 205490
costs 204615
nothing 204058
while 203982
question 203974
ensure 203905
ch 203726
ling 203696
came 203633
apply 202934
Good 202493
specific 202477
appropriate 202368
force 201457
head 201233
relevant 200199
ic@@ 199735
proceedings 199080
requirements 199019
tra@@ 198570
world 196999
least 196863
second 195814
ab@@ 195700
side 194849
el 194563
U@@ 194377
different 193347
great 192778
course 192401
done 191800
be@@ 191542
support 191146
service 190656
every 190469
la@@ 190308
sp@@ 189674
ag@@ 189636
control 189369
line 189038
amount 189000
keep 188653
Parliament 188491
li@@ 188362
action 188338
until 188310
given 187567
on@@ 187546
since 186556
countries 186391
ia 185967
ies 185638
country 185500
per 185249
therefore 184444
ac@@ 184409
guy 184319
based 183783
hand 183510
together 183465
ti@@ 183276
il@@ 183134
lo@@ 183119
x 182943
applicable 182871
risk 182549
kind 182417
T 182284
enough 182166
light 181656
cases 180846
respect 180380
party 179822
having 179704
sir 179509
Committee 179108
men 178795
wanted 178762
um 178360
Did 178173
provide 178033
believe 177910
ity 177649
value 177241
above 177083
r@@ 177053
subject 176409
many 176266
Get 175790
parties 175483
ant 175329
feel 175272
ally 175198
body 174893
On 174743
economic 174671
ge 174464
took 174240
development 173925
Y@@ 173894
business 172806
bo@@ 172739
saw 172524
protection 171943
form 171842
house 171742
General 171353
evidence 171270
ur@@ 170883
money 170882
everything 170774
st 170615
es@@ 170435
coming 169777
taking 169583
In@@ 169402
went 168931
knew 168898
room 168799
pre@@ 168641
face 168345
activities 168278
re 167955
far 167789
Can 166804
report 166510
fact 166492
EN 166450
Please 166215
patients 166148
high 165731
ence 165653
view 165063
sc@@ 165015
general 164768
please 164649
policy 164363
happened 164180
to@@ 164140
ed@@ 163916
h 163887
best 163796
id@@ 163769
called 162443
et@@ 162423
leave 162406
S 162305
ary 161773
ex@@ 161763
dead 161737
ter 161416
Con@@ 161379
management 161174
lot 161133
common 160924
authority 160633
care 159664
ul@@ 159409
area 159133
once 158932
However 158587
One 158552
matter 158541
rights 158064
company 158050
whole 157856
Go 157727
j@@ 157137
treatment 156922
als 156823
water 156649
change 156194
OJ 155645
else 155540
seen 155471
f 155290
fine 155225
heard 154961
Official 154312
real 154252
com@@ 153766
ous 153533
working 153523
ship 153191
wrong 153132
required 153059
em@@ 153022
concerning 152971
EUR 152765
applicant 152566
wo 152556
Maybe 152550
po@@ 152515
next 152459
guys 152212
type 151971
x@@ 151935
big 151765
father 151695
ance 151647
established 151308
bad 150783
production 150234
someone 150186
family 150150
/EC 149838
ask 149801
ical 149792
considered 149683
r 149338
p. 149295
months 149292
over@@ 149066
op@@ 149051
car 149009
Agreement 148987
girl 148653
de 148620
qu@@ 148616
further 148520
th 148298
mind 148287
per@@ 148204
D 148063
E 147924
eyes 147775
stop 147263
open 146661
sub@@ 146554
show 146549
implementation 146428
ates 146202
These 145819
res 145719
access 145500
looking 145497
air 145462
St@@ 144826
kill 144768
Journal 144732
asked 144479
December 144355
et 144159
ter@@ 144068
few 143787
power 143713
hear 142818
ap@@ 142606
important 142507
Treaty 142311
THE 142032
ne@@ 141809
full 141790
documents 141298
effect 141254
laid 141112
ans 140691
human 140673
security 140615
pay 140597
competent 140582
yet 140276
present 139594
understand 139573
v@@ 139513
trying 139407
ins 139119
trade 138931
using 138703
Republic 138415
adopted 138280
list 138081
king 138042
test 137398
Al@@ 137202
request 137178
meet 136940
free 136282
Here 136220
mother 136210
ings 136129
Th@@ 136012
talking 135613
either 135575
job 135473
inter@@ 135465
ls 135411
mo@@ 135354
su@@ 135353
At 135341
Re@@ 135130
ents 135079
related 134931
See 134913
making 134402
sed 134250
si@@ 134141
B 133288
Mar@@ 133164
relating 133145
il 133125
getting 133006
X 132944
procedures 132562
social 131759
assessment 131604
price 131444
rate 131052
ors 130807
start 130725
interest 130662
ph@@ 130628
ta 130551
friend 130429
w 130336
Of 129812
ment 129806
for@@ 129767
ability 129327
agreement 129265
ec@@ 129203
ics 129179
five 128842
ir@@ 128754
stay 128481
woman 128190
live 128147
mg 128098
position 128092
Other 127747
Because 127677
ent@@ 127367
ks 127217
hell 127112
programme 127051
z@@ 126892
With 126841
looked 126290
Right 126084
land 125990
reference 125695
remember 125492
cover 125488
child 125379
later 125369
tions 125260
ry 125222
boy 124878
children 124836
door 124347
total 124321
om@@ 124291
million 123744
ha@@ 123582
main 123520
low 123355
act 123234
'@@ 123027
situation 123017
Ch@@ 123002
sk@@ 122983
blood 122791
ago 122347
yourself 122107
II 121935
hard 121468
try 121043
ically 120911
today 120439
term 120201
four 119779
brought 119690
international 119652
under@@ 119563
ru@@ 119490
persons 119295
hours 119274
do@@ 119099
small 119064
May 118951
Z@@ 118637
cooperation 118116
R 118091
no@@ 118059
clear 117865
carried 117507
fi@@ 117135
special 117109
systems 117043
gra@@ 116980
His 116884
plan 116808
group 116708
legislation 116351
goods 116319
OF 116298
close 116271
tax 116164
run 115563
idea 115549
te@@ 115498
due 115481
state 115351
problem 115167
ar 115143
known 115082
F 115029
granted 115023
gone 114964
food 114523
field 114508
ty 114207
measure 114080
minutes 114023
effects 113938
* 113902
technical 113819
alone 113797
section 113771
needs 113657
ig@@ 113566
actually 113357
Hello 113350
maybe 113279
energy 112936
purpose 112445
bring 112119
single 112015
June 111869
directly 111755
der 111749
killed 111522
wait 111520
up@@ 111517
car@@ 111495
ments 111430
id 111315
safety 111308
Ex@@ 111279
By 110940
principle 110778
bed 110679
dose 110638
ut@@ 110600
(@@ 110505
covered 110367
nice 110258
local 110093
ard 109630
soon 109503
par@@ 109468
P 109212
Articles 109192
mon@@ 109178
Thanks 109090
ho@@ 109080
min@@ 108913
himself 108854
half 108770
ering 108651
z 108644
pe@@ 108605
health 108480
fucking 108443
morning 108265
ness 108205
held 108109
play 108061
areas 107962
regional 107200
move 107185
pa@@ 107169
paid 107145
key 107031
mat@@ 106710
include 106705
process 106467
intended 106236
payment 106165
wife 106087
he@@ 106068
v 105752
ing@@ 105725
issue 105629
submitted 105562
times 105531
so@@ 105494
out@@ 105469
ion 105359
ob@@ 105115
ler 104974
moment 104950
result 104898
pursuant 104813
ction 104674
according 104354
… 104152
bit 104117
sector 104103
lost 103959
final 103824
gave 103651
applied 103565
met 103471
od@@ 103466
ready 103461
An@@ 103450
Hi 103399
mis@@ 103308
(2 103174
framework 102894
An 102726
upon 102641
ce 102428
ve 102387
read 102226
office 102164
sent 102158
though 102121
Europe 102091
ex 102033
EEC 102004
ci@@ 101967
Pro@@ 101954
reason 101947
ol@@ 101800
additional 101695
myself 101672
quality 101506
true 101501
friends 101329
baby 101026
ice 100799
table 100754
gu@@ 100649
hands 100647