Soapbox Rants and Raves

Feb 14 2009

The last word on Continuous Integration…

Category: Continuous Integration — Phil @ 9:22 am

My last rave about Continuous Integration (CI)… I happened to find a really interesting document this week, and I just had to share it… The main point that I wanted to stress is the value of CI. The study was from a very small sample, but the results where in line with my personal views. The document is a very good comparison of twelve different tools and provides a good background on why one would use CI. It is easy to read and contains lots of interesting graphs.

The document is a study of Continuous Integration tools by Fontys University of Applied Sciences in Venlo, Netherlands. This study showed that Cruise Control is still the leader in this space; probably due t o the fact that the Cruise Control has been around for almost 10 years. Hudson, which has only been around for 2 years, appears to be closing in fast on the Cruise Control market share. I found another website that shows Hudson with a significant portion of the CI market. To my surprise, there appears to only be a couple of real contenders, all of the other tools are not well represented.

I also wanted to throw in this last graph to reinforce the dominance of Subversion as a version control system. It has been interesting to watch how fast the open-source community moved away from CVS over the last couple of years. I think it will be very interesting to follow the growth of Git. It has received a lot of press over the past year and seems to create a religious debate when compared with other tools. Just what we need! I was shocked to see the significant projects using Git: Ruby on Rails, Android, Fedora, X.org, just to name a few.

https://www.beilers.com/wp-content/plugins/sociofluid/images/digg_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/reddit_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/dzone_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/stumbleupon_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/delicious_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/blinklist_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/blogmarks_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/google_48.png

https://www.beilers.com/wp-content/plugins/sociofluid/images/facebook_48.png

Comments (0)

Feb 10 2009

Hudson Overview

Category: Continuous Integration,Testing — Phil @ 10:48 pm

I was playing with Hudson today in what I would call a non-standard, maybe non-friendly Linux box. The first time I setup Hudson, Java and Ant were installed in the standard locations; once I configured my projects, Hudson just went to work. On the non-standard box, nothing was installed in the expected locations, fortunately this was no big deal. The Hudson configuration options are simple and numerous. The system level configuration page has options to configure the JDK, Ant, Maven, Shell, and email settings; which are all specific to the machine that Hudson is installed on. At first, I thought this might be limiting, as very few projects use the same version of these tools. Luckily, the configuration page has the ability to specify the JAVA_HOME and ANT_HOME for multiple versions of each tool. This allows each project to specify which version of the tool they want to use in their build process, pretty simple.

One of the more interesting system level configurations addresses Hudson’s security. There are five different security options, from no security to per-project security. For authentication, I configured Hudson to use an LDAP server. This took a little trial and error, as this feature does not seem to be well documented. Fortunately, it only took a couple of attempts and the login screen started working. I chose to implement project-based security; this allowed me to delegate the responsibility of each user’s role to the project’s owner. This seemed like a good approach for limiting the amount of work required by the Hudson administrator. There could be simpler configurations, especially if you wanted to manage fewer people, but this approach gave me the finest grain control over each person’s ability… which might actally be overkill is practice. I would really need to see this working on a real project before I would be able to suggest the best security option, but it would seem to work in multiple environments.

The final step is to create and configure an individual project, which is also very straight forward. First, you pick the version control system and enter the repository and access information. Next, select the Ant-based project option and type in the Ant target name that is responsible for the continuous integration. There are multiple options you can configure here as well, but that is all I needed to start the process. Because Java and Ant were not installed in their normal locations, I selected the appropriate versions, as configured in the system level. That was it. I hit the build button and off it went. Hudson provides all kinds of visual feedback on the dashboard, letting you know exactly what is building, and even predicts how long until the current build finishes. One of the more interesting features is the ability to watch the build from within the dashboard (web page). Hudson uses AJAX to capture the log file of the running Ant process and shows a live update to the user. Pretty cool, it is no different than running Ant in a local shell!

This tool seems significantly simpler to get working than Cruise Control. I really like that fact that every project can be configured to match its own requirements. Some projects might want to use Checkstyle and PMD, another project might want to use FindBugs; not a problem. Once the plug-ins are installed by the administrator, Hudson makes them available to each project and automatically published the collected results. Because of this project centric view, it is even easier to integrate with multiple version control systems, each project simply chooses the appropriate back-end.

I did want to mention that Hudson seems to be a tool that extends beyond the typical developer requirements. As I mentioned in a previous post, QA groups can also use Hudson for activities other than continuous integration. One interesting feature is Hudson’s ability to monitor external jobs. This allows you to record the execution of a process run outside Hudson, even on a remote machine. It was designed so that you can use Hudson as a dashboard of your existing automation system. Hudson even have multi-server scalability built-in. This allows the environment to be configured with helper machines to distribute the processing load, taking advantage of the remote resources, while centrally managing and monitoring the process.

Hudson appears to have been pretty well thought out. Hopefully someday soon, I can use it for real!

Comments (0)

Feb 09 2009

Spring Utility Classes…

Category: Java — Phil @ 9:41 pm

Call me lazy or crazy, but I have never really taken the time to look at everything that the Spring Framework can provide. I read an interesting web page the other day, complaining about the size of different Java frameworks. The author ranked Spring as the number one in “Complexity Pain” with over 2,400 classes. If you think about it, that is really amazing . Out of curiosity, I decided to look at the JavaDoc index for the Core Spring framework. It is actually quite impressive or quite paralyzingly!

Sometime back, I discovered something in Spring that I doubt is all that well known, but probably very useful to the average Java project, the Spring Util package. I once worked with a developer who liked to put guard statements inside all of his methods. He created his own assertion class that would look for null values or null parameters, and create informative exceptions when the method was used incorrectly (the guard was true). It was a little more helpful than the basic null pointer exception and much more convenient than adding a bunch of “if” blocks. While I was not accustomed to this programming style, I ultimately became more accepting of this practice. One day when I was creating a jUnit test, I accidentally discovered the Spring Util Assert class. The Spring Assert class had many more guard options than the one we used and the additional benefit of not being in our code base! Code is a liability… as one of my friends likes to say!

I would highly recommend that anyone using Spring become familiar with the classes in the Util package. I was actually quite surprised by the variety of support; from Java 5 annotations, collection utilities, numeric conversions, to the copying of files and many more. If you really think about it, the large number of support classes should not be all that surprising. Developers always seem to need these type of classes when building non-trivial software. Obviously, the more interesting and valuable Spring classes (the reason you would actually want to use the Spring Framework!) required these reusable utility classes to provide the overall functionality. So, why don’t we take advantage of them too?

Comments (0)

Feb 07 2009

Free Norton Antivirus Upgrade…

Category: Windows — Phil @ 3:35 pm

I would not say that I’m a huge Norton fan, but I have had pretty good luck with them in the past. I’m sure there are better options, but for the price, securing 4 different machines, Norton works out well for me. The 2009 version of Norton seems smaller and less intrusive than previous versions; just my personal observation. Even more interesting, Norton released an Antivirus version for Gamers this year. I guess Norton finally realized the “bloat” their software was adding, was really getting out of hand.

Anyway, I happened to boot up my Windows laptop last night, and a Norton window popped open and said that I could upgrade my 2008 Antivirus to the 2009 version, for free. I was a little skeptical, but a quick Google search confirmed the deal. Apparently, with the release of the Norton 2009 suite of software, Norton as made available free upgrades to 2009 for anyone currently using either 2006, 2007 or 2008 versions.

Not a super big deal, but I always like installing new software, especially if it is free!

Comments (1)

Feb 07 2009

Continuous Integration

Category: Continuous Integration — Phil @ 11:07 am

I embraced continuous integration many years ago for purely selfish reasons, but it did not take long to see the real value of the process. I happened to work on a team where developers continually forgot to check in all of their work. Being an early morning person, I would be the first one to sync out the previous days changes; at least once a week, my work area would be unbuildable because of missing files. I would end up wasting time mocking up an object or figuring out how to work around the problem.

Enter Cruise Control. I originally setup the tool for notification purposes, cruise would monitor the CVS repository for changes and kick off the build script after each check in. If the build failed, anyone who made changes since the last successful build will be notified of the failure via email. To ensure that the developers would fix the problem, we enabled the spam feature. Cruise would continue to attempt building the project until it was successful. This could result in numerous email messages per hour, and was usually a pretty good motivator to fix the problem. We actually had to institute a higher level of encouragement on some projects, the “Bagel Rule”. If you were responsible for breaking the build for over 24 hours, you had to bring in bagels for the team. This rule worked wonders!

Once the developers got used to the process, we started to crank up the expectations. We could use Cruise to improve the quality of our code, enabling tools like Checkstyle and PMD. If the code did not conform to our standards or was overly complex, the build was marked as a failure. These tools essentially automated a basic code review process. They did not guarantee a good design, but did a pretty good job at ensuring that the code was well structured and maintainable. The most valuable Cruise integration was the addition of jUnit and Clover. By executing the jUnit suite after each check in, helped us discover any unintended sided effects induced by the changes. By combining the execution of the jUnit suite with code coverage data (we happened to use Clover), gave us a quantitative value of the confidence that we could place on our code. If we had low code coverage, it was impossible to have high confidence in our code’s correctness, or even in our ability to refactor the code and ensure that that it still worked. Conversely, if we had a decent quality jUnit suite and a high code coverage percentage, then we felt pretty good about the correctness o the code base and had complete confidence in our ability to refactor.

Cruise Control has been around for quite a few years and is now a very mature tool. This is one of those areas that I have not recently researched, but was surprised by how many options are now available to development teams. Cruise Control is fairly easy to setup and does exactly what it needs to do, from an continuous integration perspective. However, it does not provide that same amount of information and value that other tools appear to provide. From a commercial product perspective, I would really like to evaluate the Bamboo tool from Atlassian. I have been throughly impressed with the Atlassian product suite. I think they really understand what developers need and how they work. My favorite open source product is Hudson. It seems to have some pretty big supporters, such as JBoss QA (Check out the link, pretty cool). What makes Hudson interesting is the plug-in infrastructure and the trending aspects. It is very easy to integrate and publish a variety of metrics in the Hudson dashboard, something that Cruise Control does not do very well at all. The dashboard gives you a good feeling of the projects health and stability. Hudson keeps a history of metrics, and displays how the project has evolved over time. Pretty cool, if you are interesting in continuously improving your code base; it gives the developers a dynamic picture of their effort. Configurability is probably one of Hudson’s greatest strengths, more on that later.

What are your experiences? Just like unit testing, I would not want to develop without my continuous integration safety net!

Comments (0)

Feb 03 2009

Unit Testing and building a Ford Focus…

Category: Testing — Phil @ 10:35 pm

I was chatting with a friend today, and he told me a story that I could not believe. More interesting, was the fact that his story sounded exactly like my last post on Software Quality. His team was not on the same page, they each had different development philosophies and others used the existing environment to squash his proposal. So, what was his crazy idea? He proposed that the project use jUnit during the development process, and to add a line item to the project plan to include unit testing. He thought if unit testing was part of the project plan, the team would have a little more incentive to participate.

To his surprise and my dismay, the project manager said, “We are not building a Mercedes, we are building a Ford Focus, and doing unit testing is essentially unnecessary”. Oh my gosh, I about blew a gasket! I have been doing test driven development for so long, I would not even know how to write code without a unit test! What am am missing? Why wouldn’t a team want to create unit tests? How do they validate what they are building? Do they just use Loggers or print lines statements to generate output and then visually inspect the results?

This is one question that I have never been able to answer; why would a developer not want to create a structured unit test? Why do they prefer to add a “main” method to execute the code, rather than simply creating a jUnit test? I will not go into the benefits of using a continuous integration tool at this time, but just having a jUnit test that other developers could execute must be of some value. Right? Why would I want to continually inspect the output results of the class execution, when I could use assertions to actually validate the results of each test? The power, flexibility, speed, and maintenance of jUnit is not even comparable to value provided by a simple main method.

I personally believe that creating a unit test adds absolutely nothing to the overall cost of development. After all, the developer has to create something to validate the code, right? I have never seen a developer just sits down, write the code, and send it off to production. If code has to be executed to be validated, why not use jUnit? Throw in a tool like Eclipse, NetBeans, or IntelliJ, and it makes unit testing almost trivial. All the developer needs to do is click on a button and tool executes the unit test; these tools even have fancy windows to quickly show the result of each test, indicating success or failure.

There could be some potential downstream cost to supporting a unit test suite, but this cost has to be the same or less than than maintaining all of those of main methods. I also believe that the cost of supporting the unit test suite is offset by the total value provided by the suite. This value will be realized as the system evolves, allowing the team to refactor code, providing a validation framework for their changes.

Help me out here… Am I wasting my time building unit tests or have the other developers just not seen the light? Actually, I don’t think I am wasting my time, nor will I quit writing unit tests any time soon!

Comments (0)

Feb 01 2009

Software Quality

Category: Software Development,Testing — Phil @ 12:00 pm

What makes a high quality piece of software? Kind of a tough question to answer; everyone has their own idea of quality. I like to look at quality from a team perspective; I believe that quality software has the following signature traits:

Shared vision, documented design
Code that is easy to change and supports refactoring
Ability to prove that the code executes correctly
Code consistency

None of these traits are original and they all have their roots in traditional software development methodologies. I believe that their relevancy was renewed by the Extreme Programming and Agile development movements and actually made possible by tools which have emerged over the last few years. There are definitely other traits that convey software quality, such as efficiency, usability, and applicability. However, I believe that these are more dependent on individual efforts, rather than a product of team cohesiveness.

I know there are many alternative views and even skeptics who claim we don’t need coding standards or unit test suites. They believe their systems represent high quality software; but how do they really know? What proof do they really have? To their defense, the applications have been running, performing real business function, requiring very little maintenance, and apparently very few bugs. But, do those criteria actually imply quality? The stability of a system is definitely an important quality trait, but I would consider it a secondary trait; one that is actually a side effect of a signature trait, proof that the code actually executes properly.

While writing, I also realized there was another dimension that supersedes all other traits, the team’s cohesiveness. I believe it is very much related to having a ‘vision’, for a team to effectively produce quality software, there needs to be complete synergy. This sounds a lot like ‘assimilation’, maybe it is, but I really don’t like that word. I don’t think I have ever seen a team without a vision, but rather too many incompatible visions; they never have the opportunity to form the unified vision. This encompasses how things are designed, how they are constructed, and even how they are tested. If the team does not have synergy, achieving quality will cost a lot more. This cost will not be a corporate cost, but more of a individual cost, the additional effort required by each member of the team to ensure the project gets finished.

There is another, more personal trait that I like to apply to my projects, the desire to do things better the next time around. I’m not sure about you, but I have never built the perfect piece of software. I always think about how I could have done a better design or a better job coding. We don’t always get the chance to redo our work. But without seriously evaluating our own work, how can we ever learn from our mistakes. It is very important that the team wants to evolve, if the team is wed to their current coding patterns and practices, then achieving higher levels of quality is going to be much harder, maybe even impossible. I think quality is evolutionary; you just don’t “make” quality happen. The team has to be interested and excited about creating the best possible software, within their current environment.

Within their current environment; it is a very interesting qualifier to the above statement. I believe many teams use their environment as an excuse to keep the status quo. I think it is very important and my personal responsibility to do things better, every day, every iteration, every assignment. I have never worked on a project that did not have some amount of built-in cushion, for all of those unplanned requirements. Moreover, if it was something that the team really believed in and wanted to do, then we made it happen; if that meant some long hours, then that is what we did. Teams need to use the slow times to their advantage, adding new tool and techniques to their toolbox, improving the development process, and going after those nagging problems that never get addressed.

I have worked with and observed teams where the software development environment was like a game, developers were challenged and excited to create clean builds, remove warnings, and even create unit test. I have seen teams actually compete to generate better code coverage numbers than a rival team. <Disclaimer>High code coverage does not imply high quality code; more on that later!</Disclaimer>. The bottom line is, these teams wanted to make their code better and doing these activities was considered fun rather than a burden or something that provided no value. To further illustrate my point, I found a plug-in for the Hudson Continuous Integration tool that I would love to try, it is call the “Continuous Integration Game”. Developers actually earn (or lose) points depending on the code they check in. Break the build, lose 10 points, add a unit test and earn a point. It may seem silly, but if inexpensive, little metrics can help energize a team, then I am all for it.

I really don’t think I addressed any of my signature traits in this post, but it was important to establish a philosophical baseline for future posts on quality software development. In future posts, I hope to address how we have used tools and techniques to continuously improve our software development process and ultimately, build better software.

Comments (0)

Jan 31 2009

Life on Pause….

Category: Misc — Phil @ 11:08 am

Kind of amazing, I am almost recovered from a two week stint with pneumonia. I don’t know where the last two weeks went. Fortunately, I was not hospitalized, basically just confined to my house (my bed) for most of that time. The weird part is thinking about all of the stuff I have not done for a while:

I gave up reading, no RSS feeds, no books, minimal email. Most of the time, I had such a bad headache, it was practically impossible to think about anything, other than trying to stay warm and not induce coughing fits.
I have not worked out in two weeks. I guess I have a pretty good excuse, if you have no lung capacity and can’t breath, it is pretty hard to work out. The funny thing is that I lost 4 pounds towards my New Year Resolution goal. I guess you really don’t need to work out, just eat chicken soup and lots of water (Sprite in my case!)
I was listening to Pandora all of the time; I would crank up my “Nickelback Radio” every morning when I got to work. I guess I actually stopped listening to music all together; I would listen to music in the morning when I worked out too.
I listen to the Sports Junkies everyday on my way to work. I have only been in the car about thee times, and that was to drive to doctor’s appointments; not much car time! I should have saved some serious gas money this month! The Junkies are a pretty entertaining show, at least I will able to hear their Super Bowl recap on Monday morning, as that will be my first day back to work.
I don’t think I’ve been to church but one time this month. I think someone in our house has been sick every weekend this month. Hopefully, we can start February off on the right foot.

I guess we are all creatures of habit and have our little routines. I never thought much about my routine before, it was just automatic. So, just how routine should life be? This is not the kind of “spice” I wanted to break up my routine, but probably a good eye-opener. We should all work to find ways to break up the daily routine every so often. Life might get pretty dull when it is just work, doing laundry, mowing the grass, doing homework, making the kids practice their instruments… the list goes on an on! I don’t know what the right answer is, but it does give me more to think about!

Comments (2)

Jan 10 2009

Sample Post From Windows Live Writer

Category: Blogging — Phil @ 9:24 pm

Just a simple test from Windows Live Writer. I have a huge backlog of thoughts in my head, but have not been able to get myself to put them down in my blog, so be prepared to start reading!

I have actually been preoccupied with LinkedIn Lately. This “social network” thing is really kind of cool. I have been thinking about and trying to locate some people that I worked with at my previous company. I happen to send a holiday message to one of my old coworkers, asked him if he knew what happened to some of our old friends. With a little more digging, I have been able to reach out to a couple of people that I have not talked with in many, many years.

One thing that cracks me up, is when you get an LinkedIn invitation from someone that just says “I want to add you to my network”. Pretty social, don’t you think? I try very hard to make my invitations very personal. Adding connections is more about adding people that I care about or really want to stay in touch with, rather than just adding random contacts to get my connection number up! I guess there are many ways of using LinkedIn; add as many people as you can, so that someday, one of them can help you out. Probably no right or wrong way, I’m sure we all have our own strategy!

My most interesting LinkedIn experience was after I posted some books on LinkedIn’s Amazon application. Out of the blue, one of my connections commented on my reading list and we started trading emails. Big deal, right? I just thought it was really cool since I have not talked to this person in about 10+ years and here we are sharing thoughts about some books! How cool is that! I thought I would share his book recommendation with you, I will certainly add it to my reading list.

If you’ve not read the Christopher Alexander books on architecture, ie, “A Pattern Language” I highly recommend them. You will never see space the same way again.
But that is not the point. You will never see your work the same way, either.

Well, this blog was really about testing Live Writer and some how I ended up writing about LinkedIn! Live Writer seems pretty cool. I don’t spend that much time in Windows, but I do really like the way Live Writer works. Much better than anything I have used on my Ubuntu box. So, if anyone has a better blog editor than ScribeFire, please let me know!

Comments (0)

Jan 04 2009

New Years Resolutions

Category: Misc — Phil @ 11:14 am

I know it is a couple of days late, but it is hard to think about resolutions when you are traveling! On the way back from Ohio, I heard a statistic on the radio that said over 50% of people don’t even bother with New Years Resolutions anymore. The primary reason for not making a resolution was because they knew they would not succeed. That seems kind of sad, doesn’t it? Yet another old tradition that is going by the wayside, as society changes for the better(?). What bothers me most, is that I thought New Year’s resolutions were the one time a year where everyone had the chance to think about making some small changes in their lives for the better. Hopefully making them better or healthier people, or maybe even doing something that would make the world a better place.

Without resolutions, when does this happen? I don’t think the world is really into continuous improvement, something that I take very seriously in my professional life, but only recently have thought about from a personal level. I thought that I would use this opportunity to actually state my improvement goals in the form of some resolutions.

Be a better father, husband, and brother
- This one is kind of hard to put in words, but my boys are getting older and I need to make sure that I “walk the talk”. They are great kids, but I need to keep re-enforcing my beliefs and morals, I only have a few more years before they are out on their own!
- Be more thoughtful and supporting as a husband. It will be 17 years of marriage this year, I know there are lots of things I can to better for the next 17 years.
- Talk to my sister more. We get along fine, but we just never seem to take the time to talk, this should be easy to fix!
Try to do better on my heath and fitness.
- I actually want to lose 10 more pounds, based on the number of magazine, radio, and television commercials I’ve seen this past week, I’m not alone!
- I have been running about 2.5 miles a day for about 18 months. I also do a few sets of sit-ups and push-ups… I plan to keep this up.
- I should give up soda, but I don’ think I can do that!!! But, I will work on eating better, better foods and sticking to smaller portions.
Learn, Play, Blog
- This sounds kind of funny, but I find blogging is actually very constructive and really helps build your writing skills. I created about a hundred plus entries on my work blog last year, which I will now start creating here instead.
- Blogging about your experiences helps cement the concepts in your mind and also makes them available to others to lean from. It is a win-win situation!
- I setup home.beilers.com in my office on an Ubuntu box last summer. It was a great learning experience and a lot of fun. I plan to move this blog to a hosted site so I don’t have to be so dependent on my box. I also would like to setup a real site for my wife’s company.
Read More
- I am not much of a reader, it seems to take so much time. I have become an avid RSS reader, reading feeds on my cell phone is such a convenience and makes reading much more possible for me.
- I finished a monster book last year, Atlas Shrugged, what a great book. I can’t wait for the movie! I need to start reading some smaller ones… stay tuned!
Update my resume
- Kind of obvious!

I hope my goals (resolutions) spark something in you as well…. I pray that this year will be less negative (the financial crisis) than 2008, and that we can all get back on the road to recovery. Happy New Year!

Comments (0)

« Previous Page — Next Page »

M	T	W	T	F	S	S
						1
2	3	4	5	6	7	8
9	10	11	12	13	14	15
16	17	18	19	20	21	22
23	24	25	26	27	28	29
30	31