Posts filed under ‘Evaluation’
LSC Wants To Answer Your Questions
Earlier, Matthew told you that LSC had released the final Technology Capacity Planning document. Well, Joyce Raby and Glenn Rawdon will be hosting a session at the LSC TIG Conference, where they want to answer your questions about this document. If you have a question that you want answered, either e-mail it to Joyce Raby or post it below, and I’ll pass the question on to her. – K
LSC Releases Final Technology Capacity Report
The Legal Services Corporation (LSC) has just released an updated version of the report, Technologies That Should Be in Place in a Legal Aid Office Today, which incorporates feedback from grantees and an advisory group. According to the LSC, they “will rely on the report when reviewing the technology plans that grantees will be required to submit along with their 2010 grant applications and renewals.” -M
Count Your Visits, Check Your Page Views
Evaluating a website is not easy. Since you don’t get to interact with your users on a regular basis, often you have to try to read your their minds based on what the server logs tell you. In addition, the meaning of the vocabulary used in the field of web analytics isn’t always obvious. (If you don’t believe me, check out this list from WebTrends. It’s nine pages when printed!)
The good news: you don’t need to know a lot of definitions or look at a lot of numbers to keep your finger on the pulse of your website. Personally, I look at two on a regular basis: visits and page views.
A visit is just like it sounds. It’s a visit to your site. It is not a hit. Visits give you a general idea of how many people are using your site. Those people, however, are not necessarily unique. For example, let’s say you read Techno.la every day. Your visits during September might be counted as 30 visits or 1 visit, depending on how Techno.la counts visits and the settings on your local computer. Or, if you got up from your computer and had left Techno.la up in your browser and your co-worker came in and started reading and surfing around, Techno.la has no way of knowing that your co-worker isn’t you and would most likely count your co-worker’s activity as part of your visit.
A page view occurs when someone views a page on your website. It is also not a hit. This number gives you an idea of what content people are looking at. By comparing this with the number of visits, you get a picture of whether people are coming to your site and reading multiple pages or whether they look at one page and leave. (Either of these cases could be good or bad depending on the length of time that a person spends the site, the purpose of the pages they are viewing, and whether you are an optimist or a pessimist.)
Of course, there are many other numbers that you can use to glean additional data. But for me, when I just need to check in, these are the two numbers that I rely on. They give me a good overview of what’s going on and signal if I need pull out my crystal ball and try to figure out more about what my users have been up to. – K
Free Friday: A Guide to Evaluating and Purchasing Major Software Systems
Rather than highlighting the usual free software and tools, this week I wanted to point out a great article published this month on Idealware by Peter Campbell (blog), the director of Information Technology at Earthjustice, which is likely to save you both time and money when making your next major software purchase (i.e. case management system or CRM solution). Also, while a RFP may not be appropriate, many of the issues that Peter discusses in the article also apply to not-so-major software and hardware purchases. -M
Free Friday: Online Survey Tool
SurveyGizmo, an extremely full-featured online survey tool, is offering nonprofits a free 30-day trial of their Enterprise account. After that you have to either pay or switch to a free account, but as a nonprofit you can save 50% on their annual Pro or Enterprise accounts. Remember also that the TIG-funded Poverty Law Survey Tool is available for free to nonprofit legal services programs. -M [Thanks to Yann Toledano for the SurveyGizmo tip via TechSoup.]
Implementing Online Surveys
On Tuesday, August 26, TechSoup is hosting a one-hour webinar about implementing online surveys. – K
Free Friday: Evaluation Handbook & Logic Model Guide
The W. K. Kellogg Foundation was one of the first foundations to encourage grantees to evaluate the outcomes of their projects. To that end, they have developed a tremendous library of free resources intended to help programs plan and implement those evaluations.
For those of you trying to grasp the basic tenets of evaluation, take a look at their Evaluation Toolkit, which covers planning, budgeting, and managing an evaluation. After that, if you still need more information, check out The Evaluation Handbook and The Logic Model Development Guide. – K
Conference Reading: Stanford Social Innovation Review
On the way to and from conferences, I usually catch up on reading. For the Equal Justice Conference, I packed two issues of the Stanford Social Innovation Review. I had picked them at the Pro Bono Net office after being intrigued by a couple of headlines. I hadn’t ever had the chance to read a full issue before, and I was quite impressed. While not necessarily about technology, a few articles are worth highlighting:
Drowning in Data - This article describes the difference between summative and formative evaluations and suggests that funders should be very careful about what type of evaluations they require nonprofits to engage in. Summative evaluations, which are conducted at the end of a project and determine whether the project met its goals, aren’t necessarily the right evaluations for nonprofits. They assess outcomes and are expensive, time consuming, and hard to do right. Nonprofits should focus on formative evaluations, which take place during a program and identify places for improvements.
From Marble to Formica (Subscription Required) – Low-income communities don’t tend to attract traditional banks. While there are many reasons, traditional banks often find that they can’t build local bases of customer support. So Union Bank of California developed partnerships and opened Cash & Save, a bank that provides savings and checking accounts, loans, financial advice, and check-cashing services. They learned some important lessons as a part of the project.
- Ask customers what they want. Services and hours mattered more to low-income communities, and they cared very little if the bank had beautiful furnishings.
- Partner with local businesses. They have an existing customer base and know the community.
- If you build it, customers won’t necessarily come. You’ve got to do it well, and you’ve got to give the customers a service that they actual want and can use.
How to Hire a Consultant (Subscription Required) – This article gives several hints to building a successful relationship with consultants.
- Hire people who come with recommendations from people without conflicts of interests.
- Consulting does not mean pro bono.
- Consultants should act professionally.
- Consultants are project partners.
- A consultant’s work is useful only if you use it.
Diversity Training Doesn’t Work (Subscription Required) – A study compared diversity training and performance feedback with both affirmative actions plans, diversity committees, and diversity staff, and mentoring and networking programs. It found that diversity training and performance feedback doesn’t work. Organizations that appointed someone to be charge – a diversity committee or staff – were best able to up the number of managers who were women or black.
Designing Trust (Subscription Required) – Don’t have a line for a graphic designer in your next website project? That could be a big mistake. Turns out that pretty and functional websites are easier to believe and easier to learn from.
Networks for Good Works (Subscription Required) – This article is a really interesting look at how networks work and influence individuals within a network. One example looks at the Mississippi Freedom Project of 1964. Over a thousand people applied, over 950 applications were accepted, but only 720 people showed up. Looking at the nearly 240 people who didn’t show up, it turned out that they were generally part of a network that wasn’t strongly involved in the movement. Those that showed up were. “In other words, the more deeply people are embedded in networks whose values are aligned with a social movement, the more willing they are to participate in that movement.” (Personally, I think that this could have huge implications for developing a new generation of pro bono volunteers.)
Government by Numbers (Subscription Required) – This is a great look at how Baltimore city government used mapping to improve the community. Originally, it started with mapping crime statistics and identifying patterns, but eventually spread through the other city departments. The CitiStat program, as the mapping project is called, has improved city numbers and accountability.
Faith in Fair Trade (Subscription Required) – Lutherans love coffee. Lutheran World Relief worked with this fact and their brand recognition to encourage Lutheran congregations to drink fair trade coffee. Through education, they got congregations to promote and use fair trade before fair trade was cool.
- K