Statistics/Content size - Revision history

StefanoZacchiroli: /* Reproducibility */

2017-10-19T15:13:46Z

Reproducibility

← Older revision		Revision as of 15:13, 19 October 2017
Line 31:		Line 31:
	SELECT length		SELECT length
	FROM content TABLESAMPLE BERNOULLI (0.1); -- 0.1% of known blobs		FROM content TABLESAMPLE BERNOULLI (0.1); -- 0.1% of known blobs
			</pre>

			Shell:
			<pre>
			psql service=swh-replica -At -f content-size-1pct.sql \| gzip -9c > content-size-1pct.txt.gz
	</pre>		</pre>

2017-10-19T15:11:02Z

Reproducibility

← Older revision		Revision as of 15:11, 19 October 2017
Line 35:		Line 35:
	R:		R:
	<pre>		<pre>
			sizes <- scan(gzfile('content-size-1pct.txt.gz'))

	length(sizes)		length(sizes)
	summary(sizes)		summary(sizes)

2017-10-19T14:55:25Z

2017-10-19T14:54:52Z

Reproducibility

2017-10-19T14:54:14Z

Reproducibility

← Older revision		Revision as of 14:54, 19 October 2017
Line 27:		Line 27:
	== Reproducibility ==		== Reproducibility ==

			SQL:
	<pre>		<pre>
	SELECT length		SELECT length
	FROM content TABLESAMPLE BERNOULLI (0.1); -- 0.1% of known blobs		FROM content TABLESAMPLE BERNOULLI (0.1); -- 0.1% of known blobs
			</pre>

			R:
			<pre>
			summary(sizes)

			png('content_sizes.png')
			hist(log10(sizes))
			dev.off()
	</pre>		</pre>

2017-10-19T14:43:48Z

← Older revision		Revision as of 14:43, 19 October 2017
Line 1:		Line 1:
	~~TODO~~		== Results ==

			Last run on <code>2017-10-19 12:38:24 +0000</code>, querying the replica DB on somerset.internal.softwareheritage.org.

			{\| class="wikitable"
			! Min.
			! 1st Qu.
			! Median
			! Mean
			! 3rd Qu.
			! Max.
			\|-
			\| 2.000e+00
			\| 1.052e+03
			\| 3.387e+03
			\| 8.011e+04
			\| 1.247e+04
			\| 1.314e+09
			\|}

			Unit is length in bytes of ''uncompressed'' contents.

			Sample size: 3.837.249 contents.



			== Reproducibility ==

			<pre>
			SELECT length
			FROM content TABLESAMPLE BERNOULLI (0.1); -- 0.1% of known blobs
			</pre>

2017-10-19T14:28:49Z

Created page with "TODO"

New page

TODO