twitter / scootDuplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

22% duplication:

19,077 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
4,359 duplicated lines

4,822 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
scheduler (13%) --> worker (70%)	2815	9 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 4,822 duplicates...

Size	#	Folders	Files	Lines	Code
176	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	727:1006 (10%) 310:589 (22%)	view
119	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	532:725 (7%) 115:308 (15%)	view
38	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1068:1118 (2%) 118:168 (6%)	view
35	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1129:1184 (2%) 203:258 (6%)	view
31	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	ttypes.go ttypes.go	2276:2320 (1%) 2413:2457 (1%)	view
26	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	2587:2624 (<1%) 2869:2906 (<1%)	view
26	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	2305:2342 (<1%) 2587:2624 (<1%)	view
26	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	2305:2342 (<1%) 2869:2906 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3588:3621 (<1%) 4515:4548 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 4319:4352 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	5250:5283 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	3389:3422 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4515:4548 (<1%) 5012:5045 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4021:4054 (<1%) 4515:4548 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3389:3422 (<1%) 4813:4846 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	5687:5720 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3389:3422 (<1%) 5250:5283 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3588:3621 (<1%) 5449:5482 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3588:3621 (<1%) 4021:4054 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	3825:3858 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4319:4352 (<1%) 5250:5283 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3389:3422 (<1%) 4319:4352 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	5012:5045 (<1%) 5449:5482 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	5250:5283 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	3144:3177 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3588:3621 (<1%) 5012:5045 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3389:3422 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3825:3858 (<1%) 4319:4352 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4319:4352 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3389:3422 (<1%) 3825:3858 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	4319:4352 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 5250:5283 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4813:4846 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4515:4548 (<1%) 5449:5482 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3825:3858 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go ttypes.go	4813:4846 (<1%) 1035:1068 (1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 4813:4846 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4813:4846 (<1%) 5250:5283 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3825:3858 (<1%) 5250:5283 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4021:4054 (<1%) 5449:5482 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4319:4352 (<1%) 4813:4846 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 3825:3858 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 5687:5720 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3144:3177 (<1%) 3389:3422 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3825:3858 (<1%) 4813:4846 (<1%)	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	4021:4054 (<1%) 5012:5045 (<1%)	view
20	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	cloudscoot.go worker.go	4668:4697 (<1%) 649:678 (3%)	view
20	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3030:3059 (<1%) 4668:4697 (<1%)	view
20	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	2176:2205 (<1%) 2457:2486 (<1%)	view
20	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	cloudscoot.go cloudscoot.go	3275:3304 (<1%) 3710:3739 (<1%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 50 unit duplicates...

Size	#	Folders	Files	Lines	Code
75	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	642:720 225:303	view
40	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	813:854 396:437	view
33	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	ttypes.go cloudscoot.go	1034:1069 3143:3178	view
29	x 3	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go cloudscoot.go worker.go	207:238 2175:2206 648:679	view
25	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1093:1119 143:169	view
23	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1161:1185 235:259	view
22	x 3	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched worker/domain/gen-go/worker	ttypes.go ttypes.go ttypes.go	1347:1370 189:212 736:759	view
22	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	cloudscoot.go worker.go	3504:3528 479:503	view
19	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1071:1091 121:141	view
18	x 3	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched worker/domain/gen-go/worker	ttypes.go ttypes.go ttypes.go	1140:1159 214:233 1120:1139	view
17	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1622:1640 603:621	view
16	x 3	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go cloudscoot.go ttypes.go	1121:1138 3196:3213 393:410	view
13	x 3	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go cloudscoot.go worker.go	249:263 2216:2230 689:703	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	882:895 465:478	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	897:910 480:493	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	912:925 495:508	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	927:940 510:523	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	942:955 525:538	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	957:970 540:553	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	972:985 555:568	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	987:1000 570:583	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	1415:1428 1182:1195	view
12	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	cloudscoot.go worker.go	2391:2404 604:617	view
12	x 2	scheduler/client worker/client	locate.go client.go	28:41 180:193	view
11	x 2	runner/runners scheduler/server	queue.go stateful_scheduler.go	21:34 69:82	view
10	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	856:867 439:450	view
10	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	869:880 452:463	view
10	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1372:1383 412:423	view
10	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1953:1964 907:918	view
10	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	cloudscoot.go worker.go	3530:3541 505:516	view
7	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	2081:2089 305:313	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	176:183 77:84	view
6	x 3	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker worker/domain/gen-go/worker	ttypes.go worker.go ttypes.go	732:739 872:879 315:322	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	741:748 324:331	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	750:757 333:340	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	759:766 342:349	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	768:775 351:358	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	777:784 360:367	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	786:793 369:376	view
6	x 3	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched worker/domain/gen-go/worker	ttypes.go ttypes.go ttypes.go	795:802 384:391 378:385	view
6	x 3	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched worker/domain/gen-go/worker	ttypes.go ttypes.go ttypes.go	804:811 632:639 387:394	view
6	x 2	scheduler/api/thrift/gen-go/scoot worker/domain/gen-go/worker	ttypes.go ttypes.go	1338:1345 1050:1057	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1661:1668 623:630	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1679:1686 641:648	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1688:1695 650:657	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1697:1704 594:601	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/domain/gen-go/sched	ttypes.go ttypes.go	1928:1935 871:878	view
6	x 2	scheduler/api/thrift/gen-go/scoot scheduler/api/thrift/gen-go/scoot	ttypes.go cloudscoot.go	2606:2613 3742:3749	view
6	x 2	scheduler/api/thrift scheduler/api/thrift	reinstate_worker.go offline_worker.go	19:26 19:26	view
6	x 3	scheduler/client/cli scheduler/client/cli scheduler/client/cli	get_status.go kill_job.go get_scheduler_status.go	20:27 23:30 22:29	view