twitter / scalding
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
21% | 13% | 23% | 15% | 27%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
scala24% | 13% | 22% | 13% | 27%
sbt0% | 96% | 0% | 0% | 3%
rb0% | 0% | 75% | 0% | 24%
java0% | 0% | 17% | 53% | 29%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
scalding-core33% | 11% | 18% | 11% | 25%
scalding-base36% | 26% | 18% | 6% | 12%
ROOT0% | 100% | 0% | 0% | 0%
scalding-serialization0% | 14% | 21% | 29% | 34%
scripts0% | 0% | 100% | 0% | 0%
scalding-beam0% | 0% | 52% | 36% | 11%
scalding-spark0% | 0% | 52% | 31% | 16%
scalding-dagon0% | 0% | 50% | 0% | 49%
scalding-commons0% | 0% | 31% | 17% | 51%
scalding-parquet0% | 0% | 23% | 38% | 37%
scalding-thrift-macros0% | 0% | 51% | 0% | 48%
scalding-parquet-scrooge0% | 0% | 44% | 20% | 35%
scalding-db0% | 0% | 35% | 0% | 64%
scalding-hraven0% | 0% | 74% | 0% | 25%
maple0% | 0% | 0% | 78% | 21%
scalding-repl0% | 0% | 0% | 44% | 55%
scalding-args0% | 0% | 0% | 81% | 18%
scalding-hadoop-test0% | 0% | 0% | 35% | 64%
scalding-cats0% | 0% | 0% | 100% | 0%
scalding-date0% | 0% | 0% | 23% | 76%
scalding-quotation0% | 0% | 0% | 0% | 100%
tutorial0% | 0% | 0% | 0% | 100%
scalding-avro0% | 0% | 0% | 0% | 100%
scalding-json0% | 0% | 0% | 0% | 100%
project0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
GeneratedTupleAdders.scala
in scalding-core/src/main/scala/com/twitter/scalding
4356 20
MultiJoin.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
2151 -
GeneratedConversions.scala
in scalding-core/src/main/scala/com/twitter/scalding
1785 46
GeneratedFlattenGroup.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
1724 46
OptimizationRules.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
931 45
Matrix.scala
in scalding-core/src/main/scala/com/twitter/scalding/mathematics
874 79
Execution.scala
in scalding-base/src/main/scala/com/twitter/scalding
674 41
build.sbt
in root
670 4
CascadingBackend.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
659 20
Grouped.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
623 32
Operations.scala
in scalding-core/src/main/scala/com/twitter/scalding
564 41
Boxed.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization
559 3
Matrix2.scala
in scalding-base/src/main/scala/com/twitter/scalding/mathematics
526 32
Dag.scala
in scalding-dagon/src/main/scala/com/twitter/scalding/dagon
491 28
trollop.rb
in scripts/lib
491 23
scald.rb
in scripts
478 28
TypedPipe.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
460 22
RichPipe.scala
in scalding-core/src/main/scala/com/twitter/scalding
434 33
FileSource.scala
in scalding-core/src/main/scala/com/twitter/scalding
385 25
MatrixProduct.scala
in scalding-core/src/main/scala/com/twitter/scalding/mathematics
376 38
BeamOp.scala
in scalding-beam/src/main/scala/com/twitter/scalding/beam_backend
375 21
CascadingExtensions.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
363 25
WritePartitioner.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
340 13
Job.scala
in scalding-core/src/main/scala/com/twitter/scalding
333 14
AsyncFlowDefRunner.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
315 16
SparkBackend.scala
in scalding-spark/src/main/scala/com/twitter/scalding/spark_backend
313 9
FunctionImplicits.scala
in scalding-core/src/main/scala/com/twitter/scalding
309 -
UnionLike.scala
in scalding-thrift-macros/src/main/scala/com/twitter/scalding/thrift/macros/impl/ordered_serialization
306 6
ScroogeStructConverter.java
in scalding-parquet-scrooge/src/main/java/com/twitter/scalding/parquet/scrooge
303 23
JoinAlgorithms.scala
in scalding-core/src/main/scala/com/twitter/scalding
302 16
ColumnDefinitionProviderImpl.scala
in scalding-db/src/main/scala/com/twitter/scalding/db/macros/impl
301 5
HashEqualsArrayWrapper.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
291 25
ExecutionOptimizationRules.scala
in scalding-base/src/main/scala/com/twitter/scalding
286 21
Config.scala
in scalding-base/src/main/scala/com/twitter/scalding
284 14
TraversablesOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
279 2
SealedTraitLike.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization
278 6
Functions.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed/functions
255 63
TreeOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization
252 2
GroupBuilder.scala
in scalding-core/src/main/scala/com/twitter/scalding
231 13
VersionedKeyValSource.scala
in scalding-commons/src/main/scala/com/twitter/scalding/commons/source
229 13
VersionedStore.java
in scalding-commons/src/main/java/com/twitter/scalding/commons/datastores
218 32
ParquetReadSupportProvider.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/macros/impl
216 1
GeneratedTypedSource.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed
214 7
BeamJoiner.scala
in scalding-beam/src/main/scala/com/twitter/scalding/beam_backend
211 26
ParquetTupleConverter.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/scheme
209 33
TypedSimilarity.scala
in scalding-core/src/main/scala/com/twitter/scalding/mathematics
209 13
HRavenHistoryService.scala
in scalding-hraven/src/main/scala/com/twitter/scalding/hraven/estimation
203 8
Op.scala
in scalding-spark/src/main/scala/com/twitter/scalding/spark_backend
201 10
HBaseScheme.java
in maple/src/main/java/com/twitter/maple/hbase
199 16
ProductOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
189 2
Files With Most Units (Top 50)
File# lines# units
Matrix.scala
in scalding-core/src/main/scala/com/twitter/scalding/mathematics
874 79
Functions.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed/functions
255 63
GeneratedFlattenGroup.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
1724 46
GeneratedConversions.scala
in scalding-core/src/main/scala/com/twitter/scalding
1785 46
OptimizationRules.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
931 45
Execution.scala
in scalding-base/src/main/scala/com/twitter/scalding
674 41
Operations.scala
in scalding-core/src/main/scala/com/twitter/scalding
564 41
MatrixProduct.scala
in scalding-core/src/main/scala/com/twitter/scalding/mathematics
376 38
ParquetTupleConverter.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/scheme
209 33
RichPipe.scala
in scalding-core/src/main/scala/com/twitter/scalding
434 33
Matrix2.scala
in scalding-base/src/main/scala/com/twitter/scalding/mathematics
526 32
Grouped.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
623 32
VersionedStore.java
in scalding-commons/src/main/java/com/twitter/scalding/commons/datastores
218 32
Dag.scala
in scalding-dagon/src/main/scala/com/twitter/scalding/dagon
491 28
scald.rb
in scripts
478 28
LocalTap.java
in maple/src/main/java/com/etsy/cascading/tap/local
178 26
BeamJoiner.scala
in scalding-beam/src/main/scala/com/twitter/scalding/beam_backend
211 26
HashEqualsArrayWrapper.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
291 25
CascadingExtensions.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
363 25
FileSource.scala
in scalding-core/src/main/scala/com/twitter/scalding
385 25
ScroogeStructConverter.java
in scalding-parquet-scrooge/src/main/java/com/twitter/scalding/parquet/scrooge
303 23
trollop.rb
in scripts/lib
491 23
TypedPipe.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
460 22
BeamOp.scala
in scalding-beam/src/main/scala/com/twitter/scalding/beam_backend
375 21
ExecutionOptimizationRules.scala
in scalding-base/src/main/scala/com/twitter/scalding
286 21
ParquetValueScheme.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet
127 20
VersionedTap.java
in scalding-commons/src/main/java/com/twitter/scalding/commons/tap
139 20
GeneratedTupleAdders.scala
in scalding-core/src/main/scala/com/twitter/scalding
4356 20
CascadingBackend.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
659 20
HBaseTap.java
in maple/src/main/java/com/twitter/maple/hbase
162 18
JobTest.scala
in scalding-core/src/main/scala/com/twitter/scalding
179 18
Joiner.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
151 17
MemorySourceTap.java
in maple/src/main/java/com/twitter/maple/tap
111 16
HBaseScheme.java
in maple/src/main/java/com/twitter/maple/hbase
199 16
AsyncFlowDefRunner.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
315 16
JoinAlgorithms.scala
in scalding-core/src/main/scala/com/twitter/scalding
302 16
Args.scala
in scalding-args/src/main/scala/com/twitter/scalding
141 15
TupleMemoryInputFormat.java
in maple/src/main/java/com/twitter/maple/tap
134 15
Reader.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization
98 15
Writer.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization
96 15
Source.scala
in scalding-core/src/main/scala/com/twitter/scalding
171 15
ScaldingDeprecatedParquetInputFormat.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet
155 14
BeamMode.scala
in scalding-beam/src/main/scala/com/twitter/scalding/beam_backend
146 14
JavaStreamEnrichments.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization
177 14
Config.scala
in scalding-base/src/main/scala/com/twitter/scalding
284 14
Job.scala
in scalding-core/src/main/scala/com/twitter/scalding
333 14
ParquetTupleConverter.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet/tuple
73 13
ParquetTupleScheme.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet/tuple
122 13
WritePartitioner.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
340 13
VersionedKeyValSource.scala
in scalding-commons/src/main/scala/com/twitter/scalding/commons/source
229 13
Files With Long Lines (Top 46)

There are 46 files with lines longer than 120 characters. In total, there are 155 long lines.

File# lines# units# long lines
scald.rb
in scripts
478 28 14
TraversablesOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
279 2 11
TreeOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization
252 2 10
SealedTraitLike.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization
278 6 9
GeneratedFlattenGroup.scala
in scalding-base/src/main/scala/com/twitter/scalding/typed
1724 46 9
ParquetValueScheme.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet
127 20 7
UnionLike.scala
in scalding-thrift-macros/src/main/scala/com/twitter/scalding/thrift/macros/impl/ordered_serialization
306 6 7
ParquetReadSupportProvider.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/macros/impl
216 1 6
ScroogeStructConverter.java
in scalding-parquet-scrooge/src/main/java/com/twitter/scalding/parquet/scrooge
303 23 6
trollop.rb
in scripts/lib
491 23 6
flatten_group_generator.rb
in scalding-core/codegen
87 4 6
ColumnDefinitionProviderImpl.scala
in scalding-db/src/main/scala/com/twitter/scalding/db/macros/impl
301 5 6
ScroogeReadSupport.java
in scalding-parquet-scrooge/src/main/java/com/twitter/scalding/parquet/scrooge
136 9 5
TupleEntrySchemeIterator.java
in scalding-core/src/main/java/com/twitter/scalding/tuple
168 11 4
HadoopTupleEntrySchemeIterator.java
in scalding-core/src/main/java/com/twitter/scalding/tuple
39 4 4
ParquetSchemaProvider.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/macros/impl
70 1 3
HBaseTap.java
in maple/src/main/java/com/twitter/maple/hbase
162 18 3
SealedTraitOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
69 2 3
ImplicitOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
47 2 3
ScroogeOuterOrderedBuf.scala
in scalding-thrift-macros/src/main/scala/com/twitter/scalding/thrift/macros/impl/ordered_serialization
50 2 3
HBaseTapCollector.java
in maple/src/main/java/com/twitter/maple/hbase
58 5 2
StringOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
100 2 2
VersionedStore.java
in scalding-commons/src/main/java/com/twitter/scalding/commons/datastores
218 32 2
typed_source_generator.rb
in scalding-core/codegen
28 2 2
ParquetTBaseScheme.java
in scalding-parquet/src/main/java/com/twitter/scalding/parquet/thrift
50 7 1
WriteSupportProvider.scala
in scalding-parquet/src/main/scala/com/twitter/scalding/parquet/tuple/macros/impl
148 1 1
QuotedMacro.scala
in scalding-quotation/src/main/scala/com/twitter/scalding/quotation
83 3 1
ProductLike.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization
164 5 1
OptionOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
129 2 1
CaseObjectOrderedBuf.scala
in scalding-serialization/src/main/scala/com/twitter/scalding/serialization/macros/impl/ordered_serialization/providers
29 2 1
lzotypedtsv_generator.rb
in scalding-commons/codegen
16 1 1
mappable_generator.rb
in scalding-core/codegen
17 1 1
scalding_gen.rb
in scalding-core/codegen
53 4 1
function_implicits_generator.rb
in scalding-core/codegen
16 1 1
tuple_adder_generator.rb
in scalding-core/codegen
37 3 1
ScaldingHfs.java
in scalding-core/src/main/java/com/twitter/scalding/tap
44 9 1
TypeDescriptor.scala
in scalding-core/src/main/scala/com/twitter/scalding
16 - 1
CascadingBinaryComparator.scala
in scalding-core/src/main/scala/com/twitter/scalding/serialization
73 2 1
SmoothedHistoryMemoryEstimator.scala
in scalding-core/src/main/scala/com/twitter/scalding/estimation/memory
90 5 1
HfsConfPropertySetter.scala
in scalding-core/src/main/scala/com/twitter/scalding
50 3 1
CascadingBackend.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
659 20 1
CascadingExtensions.scala
in scalding-core/src/main/scala/com/twitter/scalding/typed/cascading_backend
363 25 1
StringTypeHandler.scala
in scalding-db/src/main/scala/com/twitter/scalding/db/macros/impl/handler
54 1 1
BlobTypeHandler.scala
in scalding-db/src/main/scala/com/twitter/scalding/db/macros/impl/handler
21 - 1
DBTypeDescriptorImpl.scala
in scalding-db/src/main/scala/com/twitter/scalding/db/macros/impl
31 1 1
ReplImplicits.scala
in scalding-repl/src/main/scala/com/twitter/scalding
151 11 1