Mailing List Archive: Varnish: Misc

Varnish Maximum Cache Size

Index | Next | Previous | View Threaded

arboeglin at herffjones

Feb 21, 2012, 10:45 AM

Post #1 of 4 (456 views)
Permalink

Varnish Maximum Cache Size

We're currently looking into our options in regards to caching data for a new application. Varnish seems to be a good solution, but I haven't found much information in regards to the maximum cache size.

We will be serving 10's of thousands of users with potentially 800GB-1TB of "hot" data in millions of files.

How does varnish scale with large cache sizes, both in terms of the amount of files, and the size of the total cache? This is assuming the hardware to support such an operation is in place.

Thanks,

Adam
_______________________________________________
varnish-misc mailing list
varnish-misc [at] varnish-cache
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc

phk at phk

Feb 23, 2012, 3:26 AM

Post #2 of 4 (457 views)
Permalink

Re: Varnish Maximum Cache Size [In reply to]

In message <kqe951cstb5yq80iqt5l4ol6.1329849783367 [at] email>, "Boeglin
, Adam R" writes:

>We will be serving 10's of thousands of users with potentially
>800GB-1TB of "hot" data in millions of files.

I have heard of several sites with that kind of workload.

It's not just plug-and-play, but it shouldn't give you any trouble.

--
Poul-Henning Kamp | UNIX since Zilog Zeus 3.20
phk [at] FreeBSD | TCP/IP since RFC 956
FreeBSD committer | BSD since 4.3-tahoe
Never attribute to malice what can adequately be explained by incompetence.

_______________________________________________
varnish-misc mailing list
varnish-misc [at] varnish-cache
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc

arboeglin at herffjones

Feb 23, 2012, 5:47 AM

Post #3 of 4 (434 views)
Permalink

RE: Varnish Maximum Cache Size [In reply to]

>It's not just plug-and-play, but it shouldn't give you any trouble.

Glad to hear.

I had read something where varnish had scaling issues with objects counts ~ 1 million, but I can no longer find it. Also, it looks like that may have been resolved in the 2.1.3 release: https://www.varnish-software.com/blog/varnish-213-released

_______________________________________________
varnish-misc mailing list
varnish-misc [at] varnish-cache
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc

perbu at varnish-software

Feb 23, 2012, 7:09 AM

Post #4 of 4 (436 views)
Permalink

Re: Varnish Maximum Cache Size [In reply to]

On Thu, Feb 23, 2012 at 2:47 PM, Boeglin, Adam R
<arboeglin [at] herffjones>wrote:

> >It's not just plug-and-play, but it shouldn't give you any trouble.
>
> Glad to hear.
>
> I had read something where varnish had scaling issues with objects counts
> ~ 1 million, but I can no longer find it. Also, it looks like that may
> have been resolved in the 2.1.3 release:
> https://www.varnish-software.com/blog/varnish-213-released

1M objects should not cause any trouble in itself. We routinely see 10s of
millions of objects.

Per.

--
Phone: +47 21 98 92 61 / Mobile: +47 958 39 117 / Skype: per.buer
*Varnish makes websites fly!*
Whitepapers <http://www.varnish-software.com/whitepapers> |
Video<http://www.youtube.com/watch?v=x7t2Sp174eI> |
Twitter <https://twitter.com/varnishsoftware>

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads