How Accumulo Compresses Keys and Values

From the Acccumulo User mailing list, Keith T said:

There are two levels of compression in Accumulo. First redundant

parts of the key are not stored. If the row in a key is the same as

the previous row, then its not stored again. The same is done for

columns and time stamps. After the relative encoding is done a block

of key values is then compressed with gzip.





As data is read from an RFile, when the row of a key is the same as

the previous key it will just point to the previous keys row. This is

carried forward over the wire. As keys are transferred, duplicate

fields in the key are not transferred.

General consensus seemed to favor double compression - compression both at the application level (i.e., compress the values) and let Accumulo compress as well (i.e., the relative encoding).



In support of double compression, Ameet K. said:

I've switched to double compression as per previous posts and

its working nicely. I see about 10-15% more compression over just

application level Value compression.

How Accumulo Compresses Keys and Values

From the Acccumulo User mailing list, Keith T said:

There are two levels of compression in Accumulo. First redundant

parts of the key are not stored. If the row in a key is the same as

the previous row, then its not stored again. The same is done for

columns and time stamps. After the relative encoding is done a block

of key values is then compressed with gzip.





As data is read from an RFile, when the row of a key is the same as

the previous key it will just point to the previous keys row. This is

carried forward over the wire. As keys are transferred, duplicate

fields in the key are not transferred.

General consensus seemed to favor double compression - compression both at the application level (i.e., compress the values) and let Accumulo compress as well (i.e., the relative encoding).



In support of double compression, Ameet K. said:

I've switched to double compression as per previous posts and

its working nicely. I see about 10-15% more compression over just

application level Value compression.

When you interrupt yourself with "crap" and "oh crap"

It's a scary thing, to be running out of patience and just not care anymore. When you find yourself still detached, it probably means you're just tired of trying to trust people, or you've given up trying to be friends with people whom you thought might share lesson-full experiences and journeys with you.

So why try? Just do what you have to do. Not because you hate what you do, but because you generally love people, and you actually love what you do, despite the seeming disintegration of relationships because of badmouthing and backstabbing.

You know you're too old to deal with bullsh*t, and you're too old to put up with crap. So you won't and you will just be yourself and you will do what you gotta do with love without so much care as to whether you're loved back.

Life after all won't always give you what you ask for. You have proven that there are people who loves you since time immemorial. You probably won't need too much. And you shouldn't ask for more than you deserve.

=)

When you interrupt yourself with "crap" and "oh crap"

It's a scary thing, to be running out of patience and just not care anymore. When you find yourself still detached, it probably means you're just tired of trying to trust people, or you've given up trying to be friends with people whom you thought might share lesson-full experiences and journeys with you.

So why try? Just do what you have to do. Not because you hate what you do, but because you generally love people, and you actually love what you do, despite the seeming disintegration of relationships because of badmouthing and backstabbing.

You know you're too old to deal with bullsh*t, and you're too old to put up with crap. So you won't and you will just be yourself and you will do what you gotta do with love without so much care as to whether you're loved back.

Life after all won't always give you what you ask for. You have proven that there are people who loves you since time immemorial. You probably won't need too much. And you shouldn't ask for more than you deserve.

=)

1 Down, 29 to Go

I am back and on the other side. I met goal number 10 on my 30 before 30 list and successfully defended my dissertation to earn that Dr. title! I defended on a Wednesday and immediately went on vacation for the remainder of the week and the next one. It was a whirlwind of stress, overwhelming emotion, family, friends, support, love and everything else. To be honest, it really didn't set in until returning to my office this week. Upon my return yesterday, I have started tying up lose ends, catching up on tasks which sat on the back burner while I worked on my research and handing over my responsibilities.



This is my last month at the University and my last month in Germany. I guess that needs another post but suddenly its all so real. It is one of those OMG (I use this expression in an effort to convey emotion and keep it PG, in my head I am thinking of some more intense words but this is a public forum) moments. I am moving out of one major phase of my life and into a new one.



I have about 5 major projects on my desk at the moment and am not sure how I am going to get them all done before Oct 26th. I also found out I have a few vacation days I didn't know I had so I need to use those in that time too. In an effort to try and get on top of my to do list, I am planning to head to work on the holiday tomorrow. Oct. 3rd is to Germans what the 4th of July is to Americans. As a foreigner, I get the significance but I need to get a presentation finalized and off my desk. Besides, I've already agreed to help a friend with some painting so there's my celebration for the day!



I think I need to add to my list, "learn to savor the moment" as I find myself constantly thinking of what's next. Right now, I am a Doctor and that feels good. In the spirit of savoring I should note this was not an easy process and I learned a lot about myself. I realized my limitations and my abilities quite clear. I learned that I can lean on my support system and I am sure I would not have made it this far if I did not have such great family and friends. So, to no one in specific and to everyone who was there when I needed to vent, asked for proof reading help or just encouraged me to not give up when I was beyond frustrated, Thank you.



Once I get them, I will post photos of my graduation cap so I can officially check the Dr. title off my list.

1 Down, 29 to Go

I am back and on the other side. I met goal number 10 on my 30 before 30 list and successfully defended my dissertation to earn that Dr. title! I defended on a Wednesday and immediately went on vacation for the remainder of the week and the next one. It was a whirlwind of stress, overwhelming emotion, family, friends, support, love and everything else. To be honest, it really didn't set in until returning to my office this week. Upon my return yesterday, I have started tying up lose ends, catching up on tasks which sat on the back burner while I worked on my research and handing over my responsibilities.



This is my last month at the University and my last month in Germany. I guess that needs another post but suddenly its all so real. It is one of those OMG (I use this expression in an effort to convey emotion and keep it PG, in my head I am thinking of some more intense words but this is a public forum) moments. I am moving out of one major phase of my life and into a new one.



I have about 5 major projects on my desk at the moment and am not sure how I am going to get them all done before Oct 26th. I also found out I have a few vacation days I didn't know I had so I need to use those in that time too. In an effort to try and get on top of my to do list, I am planning to head to work on the holiday tomorrow. Oct. 3rd is to Germans what the 4th of July is to Americans. As a foreigner, I get the significance but I need to get a presentation finalized and off my desk. Besides, I've already agreed to help a friend with some painting so there's my celebration for the day!



I think I need to add to my list, "learn to savor the moment" as I find myself constantly thinking of what's next. Right now, I am a Doctor and that feels good. In the spirit of savoring I should note this was not an easy process and I learned a lot about myself. I realized my limitations and my abilities quite clear. I learned that I can lean on my support system and I am sure I would not have made it this far if I did not have such great family and friends. So, to no one in specific and to everyone who was there when I needed to vent, asked for proof reading help or just encouraged me to not give up when I was beyond frustrated, Thank you.



Once I get them, I will post photos of my graduation cap so I can officially check the Dr. title off my list.

Apostle Lovella Mogere ~ Crossing over into your Spiritual Threshhold