spotify / big-data-rosetta-codeDuplication

spotify / big-data-rosetta-code

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Duplication Overall

10% duplication:

942 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
98 duplicated lines

10 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 10 longest duplicates.

See data for all 10 duplicates...

Size	#	Folders	Files	Lines	Code
10	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	87:98 (9%) 125:136 (9%)	view
9	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	103:115 (8%) 141:152 (8%)	view
9	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	JoinLogs.scala JoinLogs.scala	74:85 (19%) 92:103 (19%)	view
8	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	PageRank.scala PageRank.scala	58:66 (17%) 79:88 (17%)	view
7	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	34:43 (6%) 68:77 (6%)	view
7	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	34:43 (6%) 103:112 (6%)	view
7	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	68:77 (6%) 141:149 (6%)	view
7	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	68:77 (6%) 103:112 (6%)	view
7	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	TfIdf.scala TfIdf.scala	34:43 (6%) 141:149 (6%)	view
6	x 2	src/main/scala/com/spotify/bdrc/pipeline src/main/scala/com/spotify/bdrc/pipeline	JoinLogAndMetadata.scala JoinLogAndMetadata.scala	77:84 (8%) 116:122 (8%)	view