Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Zope: Web

Error Type, IOError, Error Value, [Errno 28] No space left on device

 

 

Zope web RSS feed   Index | Next | Previous | View Threaded


lists at zopyx

Aug 3, 2009, 9:01 AM

Post #1 of 21 (11833 views)
Permalink
Error Type, IOError, Error Value, [Errno 28] No space left on device

We run out of disk space for the zope.org site.

Andreas
Attachments: lists.vcf (0.31 KB)


jens at dataflake

Aug 3, 2009, 10:12 AM

Post #2 of 21 (11645 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Aug 3, 2009, at 18:01 , Andreas Jung wrote:

> We run out of disk space for the zope.org site.

Does this error still occur? I see 12 GB free on that drive, but
there's two other people who logged in before me, maybe they deleted
something.

jens


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp3GmoACgkQRAx5nvEhZLKJ6QCgiRuvijMieeuzE266cY+DoBen
VwIAoJSxTmoe5R5+c4czJaf3UcRSvjhn
=Lqqi
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


lists at zopyx

Aug 3, 2009, 10:13 AM

Post #3 of 21 (11642 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

On 03.08.09 19:12, Jens Vagelpohl wrote:
>
> On Aug 3, 2009, at 18:01 , Andreas Jung wrote:
>
> > We run out of disk space for the zope.org site.
>
> Does this error still occur? I see 12 GB free on that drive, but
> there's two other people who logged in before me, maybe they deleted
> something.
>
Tnx, I can work again.

Andreas
Attachments: lists.vcf (0.31 KB)


david at zope

Aug 3, 2009, 10:22 AM

Post #4 of 21 (11699 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Joseph and I both cleaned off some things. I also modified the repozo
backup cleanup script to only keep six days of backups, otherwise we
would have run out of space again either in a week or the next time
the database packed. The major space usage was the Data.fs, the
Data.fs.old, and two full FS backups made by repozo.

--Dave
On Aug 3, 2009, at 1:12 PM, Jens Vagelpohl wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
>
> On Aug 3, 2009, at 18:01 , Andreas Jung wrote:
>
>> We run out of disk space for the zope.org site.
>
> Does this error still occur? I see 12 GB free on that drive, but
> there's two other people who logged in before me, maybe they deleted
> something.
>
> jens
>
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.8 (Darwin)
>
> iEYEARECAAYFAkp3GmoACgkQRAx5nvEhZLKJ6QCgiRuvijMieeuzE266cY+DoBen
> VwIAoJSxTmoe5R5+c4czJaf3UcRSvjhn
> =Lqqi
> -----END PGP SIGNATURE-----
> _______________________________________________
> Zope-web maillist - Zope-web [at] zope
> http://mail.zope.org/mailman/listinfo/zope-web

Systems Administrator
Zope Corp.
540-361-1722
david [at] zope



_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jens at dataflake

Aug 3, 2009, 10:24 AM

Post #5 of 21 (11625 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Aug 3, 2009, at 19:22 , David Lawson wrote:

> Joseph and I both cleaned off some things. I also modified the repozo
> backup cleanup script to only keep six days of backups, otherwise we
> would have run out of space again either in a week or the next time
> the database packed. The major space usage was the Data.fs, the
> Data.fs.old, and two full FS backups made by repozo.

Alright, thanks for jumping onto it so quickly!

jens



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp3HUgACgkQRAx5nvEhZLLP6wCdH0owTDMFlWaVtdMFuYfhERYx
z7oAn348M9nLuYuLg9NfqC23VBeYSLke
=6HrL
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


lists at zopyx

Aug 3, 2009, 10:25 AM

Post #6 of 21 (11652 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

On 03.08.09 19:24, Jens Vagelpohl wrote:
>
> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>
> > Joseph and I both cleaned off some things. I also modified the repozo
> > backup cleanup script to only keep six days of backups, otherwise we
> > would have run out of space again either in a week or the next time
> > the database packed. The major space usage was the Data.fs, the
> > Data.fs.old, and two full FS backups made by repozo.
>
> Alright, thanks for jumping onto it so quickly!

Right now zope.org is dead - all requests are hanging.

Andreas
Attachments: lists.vcf (0.31 KB)


jens at dataflake

Aug 3, 2009, 10:28 AM

Post #7 of 21 (11644 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Aug 3, 2009, at 19:25 , Andreas Jung wrote:

> On 03.08.09 19:24, Jens Vagelpohl wrote:
>>
>> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>>
>>> Joseph and I both cleaned off some things. I also modified the
>>> repozo
>>> backup cleanup script to only keep six days of backups, otherwise we
>>> would have run out of space again either in a week or the next time
>>> the database packed. The major space usage was the Data.fs, the
>>> Data.fs.old, and two full FS backups made by repozo.
>>
>> Alright, thanks for jumping onto it so quickly!
>
> Right now zope.org is dead - all requests are hanging.

It works perfectly fine for me.

jens



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp3HkAACgkQRAx5nvEhZLIujwCdEvNmHBw03c8E6fc8Te1YaKdC
u7QAnAkIA+njy09Zug9hscZYNzgbUJgR
=Z1/f
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


lists at zopyx

Aug 3, 2009, 10:31 AM

Post #8 of 21 (11705 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

On 03.08.09 19:28, Jens Vagelpohl wrote:
>
> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>
> > On 03.08.09 19:24, Jens Vagelpohl wrote:
> >>
> >> On Aug 3, 2009, at 19:22 , David Lawson wrote:
> >>
> >>> Joseph and I both cleaned off some things. I also modified the repozo
> >>> backup cleanup script to only keep six days of backups, otherwise we
> >>> would have run out of space again either in a week or the next time
> >>> the database packed. The major space usage was the Data.fs, the
> >>> Data.fs.old, and two full FS backups made by repozo.
> >>
> >> Alright, thanks for jumping onto it so quickly!
>
> > Right now zope.org is dead - all requests are hanging.
>
> It works perfectly fine for me.
*shrug* creating a new document took roughly 15 minutes. During
that time all requests were hanging on my side. They terminated
after the documented was created...anyway...old Plone crap.

Andreas
Attachments: lists.vcf (0.31 KB)


jim at zope

Aug 3, 2009, 10:36 AM

Post #9 of 21 (11641 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Sorry, I should have responded earlier. We're digging into it.

Jim

On Mon, Aug 3, 2009 at 1:31 PM, Andreas Jung<lists [at] zopyx> wrote:
> On 03.08.09 19:28, Jens Vagelpohl wrote:
>>
>> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>>
>> > On 03.08.09 19:24, Jens Vagelpohl wrote:
>> >>
>> >> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>> >>
>> >>> Joseph and I both cleaned off some things.  I also modified the repozo
>> >>> backup cleanup script to only keep six days of backups, otherwise we
>> >>> would have run out of space again either in a week or the next time
>> >>> the database packed.  The major space usage was the Data.fs, the
>> >>> Data.fs.old, and two full FS backups made by repozo.
>> >>
>> >> Alright, thanks for jumping onto it so quickly!
>>
>> > Right now zope.org is dead - all requests are hanging.
>>
>> It works perfectly fine for me.
> *shrug* creating a new document took roughly 15 minutes. During
> that time all requests were hanging on my side. They terminated
> after the documented was created...anyway...old Plone crap.
>
> Andreas
>
> _______________________________________________
> Zope-web maillist  -  Zope-web [at] zope
> http://mail.zope.org/mailman/listinfo/zope-web
>
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 3, 2009, 10:52 AM

Post #10 of 21 (11645 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

We cleaned up some old files and the space problem is addressed, at
least for a few months. We'll look into getting some newer hardware
for the storage server.

We also restarted the app servers, although the app still seems to be
quite slow.

Jim

On Mon, Aug 3, 2009 at 1:36 PM, Jim Fulton<jim [at] zope> wrote:
> Sorry, I should have responded earlier. We're digging into it.
>
> Jim
>
> On Mon, Aug 3, 2009 at 1:31 PM, Andreas Jung<lists [at] zopyx> wrote:
>> On 03.08.09 19:28, Jens Vagelpohl wrote:
>>>
>>> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>>>
>>> > On 03.08.09 19:24, Jens Vagelpohl wrote:
>>> >>
>>> >> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>>> >>
>>> >>> Joseph and I both cleaned off some things.  I also modified the repozo
>>> >>> backup cleanup script to only keep six days of backups, otherwise we
>>> >>> would have run out of space again either in a week or the next time
>>> >>> the database packed.  The major space usage was the Data.fs, the
>>> >>> Data.fs.old, and two full FS backups made by repozo.
>>> >>
>>> >> Alright, thanks for jumping onto it so quickly!
>>>
>>> > Right now zope.org is dead - all requests are hanging.
>>>
>>> It works perfectly fine for me.
>> *shrug* creating a new document took roughly 15 minutes. During
>> that time all requests were hanging on my side. They terminated
>> after the documented was created...anyway...old Plone crap.
>>
>> Andreas
>>
>> _______________________________________________
>> Zope-web maillist  -  Zope-web [at] zope
>> http://mail.zope.org/mailman/listinfo/zope-web
>>
>>
>
>
>
> --
> Jim Fulton
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


lists at zopyx

Aug 6, 2009, 12:43 AM

Post #11 of 21 (11641 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Same issue this morning. This must be fixed soon - otherwise we can not
proceed with the releases.

Andreas

On 03.08.09 19:52, Jim Fulton wrote:
> We cleaned up some old files and the space problem is addressed, at
> least for a few months. We'll look into getting some newer hardware
> for the storage server.
>
> We also restarted the app servers, although the app still seems to be
> quite slow.
>
> Jim
>
> On Mon, Aug 3, 2009 at 1:36 PM, Jim Fulton<jim [at] zope> wrote:
>
>> Sorry, I should have responded earlier. We're digging into it.
>>
>> Jim
>>
>> On Mon, Aug 3, 2009 at 1:31 PM, Andreas Jung<lists [at] zopyx> wrote:
>>
>>> On 03.08.09 19:28, Jens Vagelpohl wrote:
>>>
>>>> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>>>>
>>>>
>>>>> On 03.08.09 19:24, Jens Vagelpohl wrote:
>>>>>
>>>>>> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>>>>>>
>>>>>>
>>>>>>> Joseph and I both cleaned off some things. I also modified the repozo
>>>>>>> backup cleanup script to only keep six days of backups, otherwise we
>>>>>>> would have run out of space again either in a week or the next time
>>>>>>> the database packed. The major space usage was the Data.fs, the
>>>>>>> Data.fs.old, and two full FS backups made by repozo.
>>>>>>>
>>>>>> Alright, thanks for jumping onto it so quickly!
>>>>>>
>>>>
>>>>> Right now zope.org is dead - all requests are hanging.
>>>>>
>>>> It works perfectly fine for me.
>>>>
>>> *shrug* creating a new document took roughly 15 minutes. During
>>> that time all requests were hanging on my side. They terminated
>>> after the documented was created...anyway...old Plone crap.
>>>
>>> Andreas
>>>
>>> _______________________________________________
>>> Zope-web maillist - Zope-web [at] zope
>>> http://mail.zope.org/mailman/listinfo/zope-web
>>>
>>>
>>>
>>
>>
>> --
>> Jim Fulton
>>
>>
>
>
>


--
ZOPYX Ltd. & Co KG \ ZOPYX & Friends
Charlottenstr. 37/1 \ The experts for your Python, Zope and
D-72070 Tübingen \ Plone projects
www.zopyx.com, info [at] zopyx \ www.zopyx.de/friends, friends [at] zopyx
------------------------------------------------------------------------
E-Publishing, Python, Zope & Plone development, Consulting
Attachments: lists.vcf (0.31 KB)


jens at dataflake

Aug 6, 2009, 1:24 AM

Post #12 of 21 (11639 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Aug 6, 2009, at 09:43 , Andreas Jung wrote:

> Same issue this morning. This must be fixed soon - otherwise we can
> not
> proceed with the releases.

I just looked and for some strange reason the ZODB has grown to over
30 GB, which means it more than doubled in size since the last full
backup on August 2. Looking at the backup files from repozo it appears
the massive growth happened over the last few days, those daily
incrementals since August 2 range from 5-6 GB in size each.

I have now freed up 3 GB by deleting the remaining delta files from
the previous round of backups, but this may not be enough seeing how
fast the database is growing. Something fishy is going on.

jens


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp6kyMACgkQRAx5nvEhZLKcMACeOu7iaFufinRDHL7QsUkvr9bJ
/wIAn3yJqvo1qiA2mE4XlCGodleA93NC
=/IOy
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 6, 2009, 2:04 AM

Post #13 of 21 (11627 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

I'm on #zope-web.

On Thu, Aug 6, 2009 at 3:43 AM, Andreas Jung<lists [at] zopyx> wrote:
> Same issue this morning. This must be fixed soon - otherwise we can not
> proceed with the releases.
>
> Andreas
>
> On 03.08.09 19:52, Jim Fulton wrote:
>> We cleaned up some old files and the space problem is addressed, at
>> least for a few months. We'll look into getting some newer hardware
>> for the storage server.
>>
>> We also restarted the app servers, although the app still seems to be
>> quite slow.
>>
>> Jim
>>
>> On Mon, Aug 3, 2009 at 1:36 PM, Jim Fulton<jim [at] zope> wrote:
>>
>>> Sorry, I should have responded earlier. We're digging into it.
>>>
>>> Jim
>>>
>>> On Mon, Aug 3, 2009 at 1:31 PM, Andreas Jung<lists [at] zopyx> wrote:
>>>
>>>> On 03.08.09 19:28, Jens Vagelpohl wrote:
>>>>
>>>>> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>>>>>
>>>>>
>>>>>> On 03.08.09 19:24, Jens Vagelpohl wrote:
>>>>>>
>>>>>>> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>>>>>>>
>>>>>>>
>>>>>>>> Joseph and I both cleaned off some things.  I also modified the repozo
>>>>>>>> backup cleanup script to only keep six days of backups, otherwise we
>>>>>>>> would have run out of space again either in a week or the next time
>>>>>>>> the database packed.  The major space usage was the Data.fs, the
>>>>>>>> Data.fs.old, and two full FS backups made by repozo.
>>>>>>>>
>>>>>>> Alright, thanks for jumping onto it so quickly!
>>>>>>>
>>>>>
>>>>>> Right now zope.org is dead - all requests are hanging.
>>>>>>
>>>>> It works perfectly fine for me.
>>>>>
>>>> *shrug* creating a new document took roughly 15 minutes. During
>>>> that time all requests were hanging on my side. They terminated
>>>> after the documented was created...anyway...old Plone crap.
>>>>
>>>> Andreas
>>>>
>>>> _______________________________________________
>>>> Zope-web maillist  -  Zope-web [at] zope
>>>> http://mail.zope.org/mailman/listinfo/zope-web
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Jim Fulton
>>>
>>>
>>
>>
>>
>
>
> --
> ZOPYX Ltd. & Co KG          \  ZOPYX & Friends
> Charlottenstr. 37/1          \  The experts for your Python, Zope and
> D-72070 Tübingen              \  Plone projects
> www.zopyx.com, info [at] zopyx  \  www.zopyx.de/friends, friends [at] zopyx
> ------------------------------------------------------------------------
> E-Publishing, Python, Zope & Plone development, Consulting
>
>
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 6, 2009, 2:51 AM

Post #14 of 21 (11672 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Michael, is there any chance you can join us?

On Thu, Aug 6, 2009 at 5:04 AM, Jim Fulton<jim [at] zope> wrote:
> I'm on #zope-web.
>
> On Thu, Aug 6, 2009 at 3:43 AM, Andreas Jung<lists [at] zopyx> wrote:
>> Same issue this morning. This must be fixed soon - otherwise we can not
>> proceed with the releases.
>>
>> Andreas
>>
>> On 03.08.09 19:52, Jim Fulton wrote:
>>> We cleaned up some old files and the space problem is addressed, at
>>> least for a few months. We'll look into getting some newer hardware
>>> for the storage server.
>>>
>>> We also restarted the app servers, although the app still seems to be
>>> quite slow.
>>>
>>> Jim
>>>
>>> On Mon, Aug 3, 2009 at 1:36 PM, Jim Fulton<jim [at] zope> wrote:
>>>
>>>> Sorry, I should have responded earlier. We're digging into it.
>>>>
>>>> Jim
>>>>
>>>> On Mon, Aug 3, 2009 at 1:31 PM, Andreas Jung<lists [at] zopyx> wrote:
>>>>
>>>>> On 03.08.09 19:28, Jens Vagelpohl wrote:
>>>>>
>>>>>> On Aug 3, 2009, at 19:25 , Andreas Jung wrote:
>>>>>>
>>>>>>
>>>>>>> On 03.08.09 19:24, Jens Vagelpohl wrote:
>>>>>>>
>>>>>>>> On Aug 3, 2009, at 19:22 , David Lawson wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>>> Joseph and I both cleaned off some things.  I also modified the repozo
>>>>>>>>> backup cleanup script to only keep six days of backups, otherwise we
>>>>>>>>> would have run out of space again either in a week or the next time
>>>>>>>>> the database packed.  The major space usage was the Data.fs, the
>>>>>>>>> Data.fs.old, and two full FS backups made by repozo.
>>>>>>>>>
>>>>>>>> Alright, thanks for jumping onto it so quickly!
>>>>>>>>
>>>>>>
>>>>>>> Right now zope.org is dead - all requests are hanging.
>>>>>>>
>>>>>> It works perfectly fine for me.
>>>>>>
>>>>> *shrug* creating a new document took roughly 15 minutes. During
>>>>> that time all requests were hanging on my side. They terminated
>>>>> after the documented was created...anyway...old Plone crap.
>>>>>
>>>>> Andreas
>>>>>
>>>>> _______________________________________________
>>>>> Zope-web maillist  -  Zope-web [at] zope
>>>>> http://mail.zope.org/mailman/listinfo/zope-web
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Jim Fulton
>>>>
>>>>
>>>
>>>
>>>
>>
>>
>> --
>> ZOPYX Ltd. & Co KG          \  ZOPYX & Friends
>> Charlottenstr. 37/1          \  The experts for your Python, Zope and
>> D-72070 Tübingen              \  Plone projects
>> www.zopyx.com, info [at] zopyx  \  www.zopyx.de/friends, friends [at] zopyx
>> ------------------------------------------------------------------------
>> E-Publishing, Python, Zope & Plone development, Consulting
>>
>>
>>
>
>
>
> --
> Jim Fulton
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


michael at d2m

Aug 6, 2009, 6:19 AM

Post #15 of 21 (11666 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jens Vagelpohl wrote:
>
> On Aug 6, 2009, at 09:43 , Andreas Jung wrote:
>
>> Same issue this morning. This must be fixed soon - otherwise we can
>> not
>> proceed with the releases.
>
> I just looked and for some strange reason the ZODB has grown to over
> 30 GB, which means it more than doubled in size since the last full
> backup on August 2. Looking at the backup files from repozo it appears
> the massive growth happened over the last few days, those daily
> incrementals since August 2 range from 5-6 GB in size each.
>
> I have now freed up 3 GB by deleting the remaining delta files from
> the previous round of backups, but this may not be enough seeing how
> fast the database is growing. Something fishy is going on.
>

Hi, this was caused by spamming 2 collector issues in member space, each
holding a transcript of about 1 MB and more.

I removed the issues, blocked the spamming user account and finally
changed default roles for everything collector related to 'Manager'.

Regards
Michael

- --
http://blog.d2m.at
http://planetzope.org

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iD8DBQFKethml0uAvQJUKVYRAlC0AJ4tkdTGdMrG56mtZM46ASZJFIgNiACfUkjg
2yX+44OxRtMaZuur2D9sNqQ=
=Wq/v
-----END PGP SIGNATURE-----

_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 6, 2009, 7:42 AM

Post #16 of 21 (11619 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Thanks!

Jim

On Thu, Aug 6, 2009 at 9:19 AM, Michael Haubenwallner<michael [at] d2m> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Jens Vagelpohl wrote:
>>
>> On Aug 6, 2009, at 09:43 , Andreas Jung wrote:
>>
>>> Same issue this morning. This must be fixed soon - otherwise we can
>>> not
>>> proceed with the releases.
>>
>> I just looked and for some strange reason the ZODB has grown to over
>> 30 GB, which means it more than doubled in size since the last full
>> backup on August 2. Looking at the backup files from repozo it appears
>> the massive growth happened over the last few days, those daily
>> incrementals since August 2 range from 5-6 GB in size each.
>>
>> I have now freed up 3 GB by deleting the remaining delta files from
>> the previous round of backups, but this may not be enough seeing how
>> fast the database is growing. Something fishy is going on.
>>
>
> Hi, this was caused by spamming 2 collector issues in member space, each
> holding a transcript of about 1 MB and more.
>
> I removed the issues, blocked the spamming user account and finally
> changed default roles for everything collector related to 'Manager'.
>
> Regards
> Michael
>
> - --
> http://blog.d2m.at
> http://planetzope.org
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.6 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iD8DBQFKethml0uAvQJUKVYRAlC0AJ4tkdTGdMrG56mtZM46ASZJFIgNiACfUkjg
> 2yX+44OxRtMaZuur2D9sNqQ=
> =Wq/v
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> Zope-web maillist  -  Zope-web [at] zope
> http://mail.zope.org/mailman/listinfo/zope-web
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jens at dataflake

Aug 6, 2009, 8:24 AM

Post #17 of 21 (11626 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I just want to mention that we will run into space problems again
tonight.

The ZODB is 32 GB in size, and there's 2 GB space left on the drive.
Any repozo run or pack at this point will fail. The only way out I can
see involves the following:

- delete all repozo backups

- pack the database manually

- delete Data.fs.old

After that repozo will start with a fresh backup.

Anyone have any better ideas?

jens


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp69Z4ACgkQRAx5nvEhZLIdzACggnNgk5wp7GIAO4aLX34zJcOD
ULEAnjRxhcr9yb9Upc6952bv7eJPMpJD
=RjRo
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


david at zope

Aug 6, 2009, 8:37 AM

Post #18 of 21 (11666 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

That's pretty much along the lines I was thinking as well when I
looked at it real quick this morning. +1 from me, fwiw.

--Dave

On Aug 6, 2009, at 11:24 AM, Jens Vagelpohl wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> I just want to mention that we will run into space problems again
> tonight.
>
> The ZODB is 32 GB in size, and there's 2 GB space left on the drive.
> Any repozo run or pack at this point will fail. The only way out I can
> see involves the following:
>
> - delete all repozo backups
>
> - pack the database manually
>
> - delete Data.fs.old
>
> After that repozo will start with a fresh backup.
>
> Anyone have any better ideas?
>
> jens
>
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.8 (Darwin)
>
> iEYEARECAAYFAkp69Z4ACgkQRAx5nvEhZLIdzACggnNgk5wp7GIAO4aLX34zJcOD
> ULEAnjRxhcr9yb9Upc6952bv7eJPMpJD
> =RjRo
> -----END PGP SIGNATURE-----
> _______________________________________________
> Zope-web maillist - Zope-web [at] zope
> http://mail.zope.org/mailman/listinfo/zope-web

Systems Administrator
Zope Corp.
540-361-1722
david [at] zope



_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 6, 2009, 8:44 AM

Post #19 of 21 (11671 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

Jens,

We're doing this. (Actually, we're going to copy the backups to
another disk first.)

We're also going to upgrade the hardware and switch to using ZRS.

Sorry, I should have acked sooner. Bad me. Bad bad me.

Jim

On Thu, Aug 6, 2009 at 11:24 AM, Jens Vagelpohl<jens [at] dataflake> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> I just want to mention that we will run into space problems again tonight.
>
> The ZODB is 32 GB in size, and there's 2 GB space left on the drive. Any
> repozo run or pack at this point will fail. The only way out I can see
> involves the following:
>
>  - delete all repozo backups
>
>  - pack the database manually
>
>  - delete Data.fs.old
>
> After that repozo will start with a fresh backup.
>
> Anyone have any better ideas?
>
> jens
>
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.8 (Darwin)
>
> iEYEARECAAYFAkp69Z4ACgkQRAx5nvEhZLIdzACggnNgk5wp7GIAO4aLX34zJcOD
> ULEAnjRxhcr9yb9Upc6952bv7eJPMpJD
> =RjRo
> -----END PGP SIGNATURE-----
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jens at dataflake

Aug 6, 2009, 8:48 AM

Post #20 of 21 (11624 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Aug 6, 2009, at 17:44 , Jim Fulton wrote:

> Jens,
>
> We're doing this. (Actually, we're going to copy the backups to
> another disk first.)
>
> We're also going to upgrade the hardware and switch to using ZRS.
>
> Sorry, I should have acked sooner. Bad me. Bad bad me.

No worries, just means less on my plate ;-)

jens

P.S.: A bigger disk would really be handy as well.



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)

iEYEARECAAYFAkp6+1kACgkQRAx5nvEhZLKZNwCdFiRW2p1ZY6DXMlFPxLTDmFQY
eFIAoKxk2VIfGQOs36U4Ie4xPwa/HDMh
=zcPd
-----END PGP SIGNATURE-----
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web


jim at zope

Aug 6, 2009, 8:52 AM

Post #21 of 21 (11636 views)
Permalink
Re: Error Type, IOError, Error Value, [Errno 28] No space left on device [In reply to]

I just looked and the transaction rates have fallen from about
200-300MB/hr to about 200-300K/hr. :)

Jim

On Thu, Aug 6, 2009 at 9:19 AM, Michael Haubenwallner<michael [at] d2m> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Jens Vagelpohl wrote:
>>
>> On Aug 6, 2009, at 09:43 , Andreas Jung wrote:
>>
>>> Same issue this morning. This must be fixed soon - otherwise we can
>>> not
>>> proceed with the releases.
>>
>> I just looked and for some strange reason the ZODB has grown to over
>> 30 GB, which means it more than doubled in size since the last full
>> backup on August 2. Looking at the backup files from repozo it appears
>> the massive growth happened over the last few days, those daily
>> incrementals since August 2 range from 5-6 GB in size each.
>>
>> I have now freed up 3 GB by deleting the remaining delta files from
>> the previous round of backups, but this may not be enough seeing how
>> fast the database is growing. Something fishy is going on.
>>
>
> Hi, this was caused by spamming 2 collector issues in member space, each
> holding a transcript of about 1 MB and more.
>
> I removed the issues, blocked the spamming user account and finally
> changed default roles for everything collector related to 'Manager'.
>
> Regards
> Michael
>
> - --
> http://blog.d2m.at
> http://planetzope.org
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.6 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iD8DBQFKethml0uAvQJUKVYRAlC0AJ4tkdTGdMrG56mtZM46ASZJFIgNiACfUkjg
> 2yX+44OxRtMaZuur2D9sNqQ=
> =Wq/v
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> Zope-web maillist  -  Zope-web [at] zope
> http://mail.zope.org/mailman/listinfo/zope-web
>



--
Jim Fulton
_______________________________________________
Zope-web maillist - Zope-web [at] zope
http://mail.zope.org/mailman/listinfo/zope-web

Zope web RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.