This feed contains pages in the "ga" aka general audience category. Most posts are either tagged as geek or ga - so you have the option of avoiding the highly technical stuff by following this tag.

One of my first experiences as an activist happened while I was a teenager - I went door to door surveying my neighbors in Lincoln, Nebraska to determine interest in recycling. My small contribution made me feel part of a movement, an experience that helped propel me through a life time of organizing and activism. Since then I have been heavily involved with both alternative media and free Internet issues - following a path toward a more global and revolutionary movement than I found in the environmental circles of the 80's in Nebraska.

Now, twenty years later, the issues of the environment, media, technology and revolutionary change are coming together in a global movement unlike anything I could have ever imagined.

Global Conference on Climate Change: Cochabamba, Bolivia, April 2010

In March, May First/People Link (MFPL) was contacted by Nick, the Media Liaison for the Global Conference on Climate Change in Cochabamba. He invited us to participate on the technology team supporting the event. After some back and forth, we received our assignment: provide a free/open source live Internet video stream of the proceedings. Our contribution would compliment the non-free software based live stream provided by the One Climate team. Taking no chances, the conference organizers wanted to ensure that we would have a way for people outside Bolivia to experience the event - even if it meant having two teams working on the same issue. Furthermore, the lead tech organizer wanted to showcase free and open source software during the event.

We immediately put our team together: Mallory, Maritza and I were tasked with going to Bolivia to provide direct support. Greg, Nat, and Daniel provided on the ground server support from New York. And Alfredo was in charge of organizing an international event to support the conference: an Internet-based, multi-city, interactive, video/audio conference connecting delegates at the conference with people from around the world who could not be there in person. Unlike the video stream - which would be more like watching TV, this event was designed to allow two-way video and audio interactions between all participants.

Web casting

What is Web casting?

Most of us have watched video online - typically we stumble upon a web site with a box and play button. This technology allows us to play video on demand - meaning that when we, the viewer, control when it starts, etc. This type of video watching requires that the video itself is pre-recorded.

Live video web casting, on the other hand, means watching a video portraying an activity that is happening live. Nothing pre-recorded; nothing on demand. We lose the ability to control when we watch it; however, we gain the experience of watching something together, with the rest of the world.

The setup for web casting involves:

  • A cable providing a live video signal and another cable providing a live audio signal (much like the cables you might use to connect your VCR or DVD player to your TV). These cables can come from a video camera shooting a live event, or a video switcher in a TV studio, or even a Television.

  • These cables are plugged into a computer that converts the signal into a digital format.

  • That computer sends the signal, over the Internet, to a server accessible to the world.

  • One (or more) web sites include the familiar box and play button that, when clicked, connects the user's browser to the server, displaying the video stream.

Our first steps

In the airport in Miami, we first heard the news of the volcano eruption in Iceland that was disrupting all European travel. Later it was confirmed: the One Climate folks, based in Europe, were not going to be able to make it - web casting was up to us entirely.

Web team

Upon arrival in Bolivia, we went to the conference site at Valley University in Tiquipaya, 30 minutes from Cochabamba. We were introduced to the local tech team - organized by Daniel Viñar, whose international nature mirrored the experience of the conference: Uruguayan by birth, his parents were exiled in France, where he grew up until he moved to Bolivia in the nineties. His team came from Paz, including paceños Freddy, Victor, Oliver, Armin, Mario, Jonathan, French ex-pats Clement, and Sylvain, and Ivan (from La Paz, studying in Peru).

In addition to us, the tech team was joined by a disparate group of web editors from around the world, some organized by Nick, others from the New York Bolivian mission (which brought 30 delegates), and many more folks who did a tremendous job editing, teaching and promoting the dynamic web site.

Our first decision for web casting was on the technology to use. We had a problem. Using free software that was controlled by the conference was non-negotiable. In addition, we preferred to use free formats and protocols. We had tested a successful web cast that used the free ogg/theora format and the free shoutcast protocol. The problem is that only people running a version of the web browser Firefox greater than 3.5 (or who had already downloaded the software needed to view ogg/theora video) would be able to view the web cast.

After some discussion, we decided that we would need to compromise on the video format and protocol, choosing the proprietary Flash format and proprietary RTMP protocol - both owned by Adoboe. A very large percentage of computers already have the software installed that is needed to view videos in the Flash format. And the RTMP protocol provides a means to send Flash videos to and from a server running Adobe's multi-thousand dollar Flash Streaming Server.

This compromise was made possible by the free software developers who created Red5 - a fully free and open source server software that works as a replacement for the Adobe software. In addition, software developers have produced client software, like Gnash, that are free and open source flash video players.

While using Red5 and Gnash is a functional compromise now (which allows people to participate fully using only free and open source software or, if they choose, the Adobe proprietary versions), in the long run, relying on the proprietary Flash format and RTMP protocol places the movement in a precarious position. At any time, Adobe can change the protocol, which could cause Red5 and Gnash to stop working seamlessly with the proprietary versions of the software. This compromise means we are not fully in control of our software.

Thanks to help from our NY crew who setup our servers, we had several servers, ready to go, with which to expirement. We immediately went to work on Saturday, trying to wrap our heads around Red 5, which was written in a language (Java) that nobody on site was familiar with. We finally figured out the steps to properly install Red5 on Debian, and then, late into the night, after hours of frustration and on the cusp of calling it a night, Mallory discovered the magic combination of steps that resulted in a successful stream from a web cam in Cochabamba to our server in New York, and then back again to a web browser. Victory! Our job was one. Or so we thought.

We knew that we were not going to web cast using the web cams attached to our laptops. The quality would be terrible (no ability to zoom or change angles) and, of course, our laptops would need to be in the room where the event was happening. Instead, our plan was to take a video feed from the Television Team - the group responsible for broadcasting the proceedings via satellite to the rest of the world. The TV Team already had organized multiple camera crews and studios for this purpose.

The next day, Sunday, we began experimenting with the device that takes a video signal (like the kind we expected to receive from the TV team) and converts it into a digital format that we could then send to our Red5 server. The tech team had purchased several Creative SB0630's for this purpose. This device proved to have a fatal problem: it shipped with proprietary Windows drivers only: we could not stream video with a computer running the free/open source Linux operating system.

Mallory, Armin and I followed Ivan into a cab and off we went to the Concha - the giant Cochabamba market, which was a 45 minute drive from the conference center. After walking for close to 30 minutes, through stalls of every item imaginable, we finally hit the electronics section, and then the computer section. We split into two groups in search of an alternative digital video converter. After 30 minutes, Mallory and I turned up empty handed, but Ivan and Armin discovered two possibilities. We settled on a a an Encore.

Back at Tiquipaya, I spent several hours trying to get our new device working on Linux, but without luck. Like the Creative SB0630, I couldn't get Linux to recognize the device as a video input. The 4 hours it took to get to and from the market really cut into our work day on Sunday, and time was getting short.

Furthermore, Daniel wanted us to test our web casting capacity that night during a pre-conference interview. In a move that would be repeated throughout the conference, we turned to Gavinda from Earth Cycles, a media maker who demonstrated an uncanny ability to have every piece of technical equipment we needed in the last minute. For the test, he turned up a Pinnacle video converter and a Windows laptop with the drivers pre-installed. Although it wasn't free software end-to-end, we nonetheless pulled together a working web stream solution just in the nick of time. We went home happy - knowing that we could at least produce a working web stream - and still with one day before the official conference kicked off on Tuesday.

On Monday morning, by the time the MFPL team had arrived, Ivan had miraculously gotten our new Encore card to work with Linux - with the help of the free software program TV Time. This was our final break through! We quickly ran a test and, with still half a day to go, we had a working, end-to-end free software based video streaming system in place.

For the second time, we thought our job was done.

Big Blue Button

Meanwhile, Alfredo was forging ahead organizing our multi-city event.

We were participating in a historic, global environmental summit - we needed a way for people to not only watch what was happening, but participate interactively with the delegates.

Our plan was to use the free/open source software Big Blue Button, which allows users to login to a web site, optionally connect your web camera, microphone and speakers, and then have a multi-person video/audio/text conference.

Alfredo's job was to bring in the audience. Thanks to his work and the support of the Bolivian Mission in NY, we received a tremendous amount of interest. By the time Mallory, Maritza and I arrived in Bolivia, Alfredo had confirmed four cities - and not only their participation, but also their commitment to organize an audience: The Brecht Forum in NY, Encuentro5 in Boston (with on the ground tech support from MFPL member and USSF volunteer Ross), the Venezuelan mission in Chicago, and a collaboration between the Latin American Solidarity Organization and Movement for Justice and Peace in Olympia, Washington.

Keep in mind: we had run limited tests from New York, but had never tried anything like this before, either conceptually or technically.

To be safe, we organized a test-run on Sunday night. All four cities "showed up" online and the results of the audio and video part were ... a disaster. Fortunately, Big Blue Button provides an interactive text chat - a format that is consistently reliable!

Via chat, we worked through all the various struggles each city had getting their video and audio working. Finally, after close to an hour, we got everyone working (and documented a BBB tip sheet for a functional multi-city conference). We all agreed to login at 6:00 pm for the real event, one hour before it was scheduled to start.

With two days before the scheduled live event (Tuesday night), the pressure was on to recruit delegates from the conference to participate on the Bolivia side. Four confirmed cities! And, since the conference hadn't started yet, we had no idea who would be available!

Maritza went to work. With the help of the Bolivian mission (via Taleigh, our delegation leader) we started making connections.

It was slow work. On Monday we had several names and sent out many emails. By Monday evening, we had one confirmation, a Peruvian Economist named Emil Sifuentes.

By Tuesday afternoon, we had two more "maybes" and we started to worry about whether Emil would be able to make it, since we had no reliable way to confirm his participation.

Tuesday at 5:00 pm, 1 hour before our pre-event test, we learned that the studio we reserved wouldn't be available after all and the alternate room we had in mind didn't have an Internet connection. Through a lot of scrambling and last minute assistance from Clement, we finally got our alternative room cabled and with the help of Victor, Oliver and Freddy we got a computer moved into place. Mallory went to work configuring the audio and video while Maritza and I scrambled to get replacement speakers for the non-working ones we had planned to use (a university staff person eventually "borrowed" them from a administrator's computer). At last, at 6:15 pm, we had all our technology working - just in time for Emil to arrive - a full 45 minutes early!

With an altitude induced migraine threatening, Maritza began prepping Emil, and then continued when Dulfredo Moyo from Accion Vida, one of our two maybes, arrived. By 7:00, our four slots were filled when Daniel and Nick joined the group. Maritza continued prepping our guests while I worked out the remaining tech kinks with our cities (every city, it turned out, was using a different computer for the live event than they did for the test on Sunday!).

Finally, at 7:30 pm we began. Maritza jumped into the role of multi-city facilitator and translator - providing a seamless transition between the conference participants and those from the other cities. Despite some technical difficulties, and brief outages of audio and video, we successfully transmitted introductions from each city, presentations from the conference participants on the Bolivia side, and lastly we took four questions - one from each city.

And... just before we ended we were joined by another city - Barcelona, Spain!

By the end of the event, we were exhausted, yet tremendously optimistic about the potential for building more effective virtual conferences.

Web casting continues....

Despite repeated requests, by Monday afternoon we still were missing the final component to make our web casting system functional: the video feed from the TV Team.

While we waited, we worked on scaling. We setup a Red5 server in Bolivia. In addition, Sylvain contacted allies in France who setup a second Red5 server. We did the same at MFPL (using our second collocation facility), while Mallory figured out how to send a single video stream to all four locations at the same time. Through some brilliant DNS wizardry (using Bind views), Daniel figured out how to direct viewers from inside Bolivia to the Bolivian server, and send viewers outside Bolivia to one of the three external servers.

Web cast

Finally, Monday night, Ivan had had enough. Under his direction, we simply moved our computer station to the room next to the main broadcasting studio and pulled a line in. By this time there was no live programming (the feed was a loop of a promo) - but at last we had a working end-to-end setup - and just in time!

Tuesday morning - panic ensued. The opening ceremony (the second most important piece to webcast - with the closing being the most important) wasn't coming in from the broadcast studio. Fortunately, at the last minute, the video feed we had been waiting for, finally arrived in the tech room, just as the opening ceremony was beginning. We quickly trucked our equipment back to the Tech room, plugged in all the cables, and at the last minute, we had the opening going out over the Internet.

Despite this success, the following two days were not spent rejoicing. Instead, we had to constantly monitor the signal - as our video source (traveling over many meters of cable) was far less reliable than we had wanted. Ivan, who had purchased a second digital video converter, finally installed a new digitizing station downstairs, plugging into a cable connection of Channel 7 - the state run channel which was also covering the event. This cable connection was provided by a satellite dish installed on the roof of the building by Entel (the recently nationalized Telecom company) specifically for the event. This backup allowed us to switch between the two sources, giving us far more flexibility in handling problems.

This approach proved critical - since on Thursday the main event of the day, the closing ceremony, was held in Cochabamba - which the Conference TV team was not covering. Therefore, we switched permanently to the video feed from Channel 7, plugging in directly to one of the Entel provide TV's in the press room.

This setup proved fairly reliable for most of the day (with the exception of the time someone with a remote control accidentally turned of the TV). However, our last disaster struck just as Hugo Chavez was finishing his speech: suddenly, the TV image froze with the message: "Sin señal" (No signal).

Through a monumental mis-communication, Entel had started breaking down the equipment for the conference, starting with the satellite dish on the roof. With barely 15 minutes until Evo Morales was scheduled to deliver the final speech of the closing, we were off line.

Looking around the room - Ivan, Mallory, Sylvain - I've never seen more dejected faces in my life. Eventually, word reached Daniel - the man we all knew as the soft spoken and gentle leader of the tech team. He demonstrated his ability to adjust to the situation: I couldn't quite follow his Spanish, but I was certain that I didn't want to be the Entel employee at the other end of that conversation.

Although his words couldn't bring back the satellite dish, his emotion sparked the team into action.

We didn't have a satellite signal but ... we did have a coaxial cable with an RF connector - the kind that can plug into a Television and act as an antenae. With all hands on deck, we plugged the cable into the television, strung the other end out of the window (ensuring that the inside wire made contact with the metal bars on the window), and, while grainy, we managed to get an over the air broadcast signal from channel 7. We were back online!

The closing

Listening to Evo speak made the whole experience come together. Naming capitalism as a primary cause of environmental destruction opens up a discussion virtually unheard of in the United States. Evo's closing, which reflected the conference as a whole, grounded the discussion in the idea that the destruction of the planet cannot be fixed by changing one or two things here or there. Instead, we need an entirely new basis for relating to each other and the world.

The connection with indigenous movements, while not prescriptive, provided a powerful testament to the historic transience of capitalism. The movement to commodify and radically reduce the world and our interactions to profit is less than 500 years old - a drop in the bucket of human history.

And, if "500 years" rings a bell - it's because the rise of capitalism has mirrored the genocide of indigenous peoples in the Americas, who, through intense struggle and resistance, continue to maintain a world view that takes a harmonious approach to the earth as a fundamental tenet.

Looking around the room during Evo's speech, I saw the exhausted but contented faces of the other techies, who either took time off from their corporate jobs or who have shunned the corporate tech sector altogether, to build international alliances based on the principles of free and open source software. I was reminded that the entire world does not run on capitalism, even now. The growing movement of people from around the world who are dedicated to building a free and open Internet, unfettered by the demands of profit and capitalism, can provide a powerful contribution to the 21st century world imagined by the conference participants - one based on collaboration and a common good.

See the final declaration of the conference (Spanish)

Posted Thu 29 Apr 2010 10:38:08 PM EDT Tags: ga

Oppression - particularly race and gender based oppression - has a long sordid history. One important aspect of oppression is exclusion. It doesn't matter whether it's officially acknowledged (segregation) or hidden (old boys networks) or something in between. It also doesn't matter whether it's explicitly based on race or gender or if that exclusion happens in a de facto way. Exclusion, in all forms, is a central tenant of oppression.

Tech culture within the Internet is one of the most gender and race-based exclusive cultures in the mainstream today. Sadly, the radical tech sub-culture of the Internet rarely challenges this exclusion and often furthers it.

Consider security. Before getting into the tech aspects of security, the general concept itself is fraught with gender and racial overtones. For example, there's the aggressive macho approach to security, or the racialized circle the wagons to defend against the "outsiders."

Our impression (and reaction) to security can vary wildly depending on our experience with oppression. It frequently comes as a surprise to one person that an idea about security could be interpreted as oppressive. However, to an entire group of people who have experienced a pattern of exclusion resembling that approach to security, it's profoundly racist or sexist.

Security and the Internet: default closed

With regard to Internet, there are an many ways to interpret security. However, within radical tech culture, most of the approaches involve exclusion.

Encrypted email, for example, requires that every participant have a special key, a working and configured program that can use the key, and access to this working installation for all email communications. If you don't have that, you can't participate.

Key-based shell access to a server is another example. A common and secure way to provide access to servers is to use an approach requiring every user to have a public key - rather than a password. You then need to connect from a computer that has the private key corresponding to your public key. More secure - yes, however it has the effect of excluding everyone without a key or the knowledge to generate one.

However, the example that is the most striking is the way we treat the concept of privacy. In radical tech culture, privacy is often the default. We decide to be private and then, maybe later, decide what we want to make public. Email list archives become private, email has to be encrypted, wikis have to be password-protected and the list goes on.

This approach requires a pre-defined group of people who are in. Nobody gets access to what this group produces unless the group decide later to make it public. And - people can only join if someone in the group can vouch for them.

Furthermore, even within this group, the overhead involved in communication is immense since every channel has to be secured before you can begin.

The result is an exclusive enclave within a network that is internationally famous for being decentralized and open. A country club on the Internet built by people who identify with left politics. And a very difficult environment for including new people.

And when a group like this is predominantly run by white men - or any other grouping of people with privilege - it effectively creates an environment that is not only exclusive but throws huge structural obstacles to challenging racism and sexism by removing itself from a bigger movement for liberation.

A "default open" approach to security

There is, of course, a need for security when organizing. However, "default closed" is not the only way to organize and, from both an anti-oppression and pro-security perspective, is not necessarily the best way.

A different approach is to consider a default open approach, and then figure out where to make exceptions. In other words:

  • Organize most activities in such a way that all newcomers can be safely treated as part of the group until they demonstrate otherwise.

  • Organize most meetings so that they are public and open to all (if it's an online - you don't need a GPG key or an SSH key to participate - although you will be encouraged to get one moving forward).

  • Publish as much information about what you are doing publicly so new people can decide whether they agree with what you are doing before deciding to participate.

This approach probably sounds familiar to veteran organizers, since it's an old method for movement building. It also may sound familiar to techies used to Unix - since it's the approach taken with the file system (all files are readable by everyone, except the small handful that should not be public).

In an organizing context, certain information and certain discussions will need to be exclusive to a smaller number of people who are trusted with the group - however, this division and explanation can be public without divulging the private information. And this distinction should be a healthy debate within the group.

This approach doesn't guarantee an oppression-free organizing environment. However, it does provide an environment in which challenging oppression can take place.

In addition, this approach makes security significantly easier. Rather than trying to secure everything, we only have to focus on a securing a smaller subset of information and communications. And, we reduce our risks of divulging private information due to a technical compromise by operating mostly in the public.

Deciding on an approach to security

Ultimately, a group's approach to security will depend on the group's priorities. There are organizing campaigns now (and from our history) in which individuals face serious persecution for having their identities divulged or activities public. Sometimes that happens when we are working in a regime with laws we do not respect, other times our politics dictate acting in a way that makes us unacceptably vulnerable. And there are a many other reasons why staying under the radar is critical for one's organizing objectives.

How a group of people decides to organize will be a result of the individuals involved and their collective politics. Ultimately, we have to consider the risks involved, the sacrifices we are willing to make, and what our political priorities are. While the decision will be different for every group, there are few areas of work more in need of attention to exclusion and oppression than the Internet.

Posted Mon 29 Jun 2009 11:57:00 AM EDT Tags: ga

Here are some of my notes from attending the second day of the Open Video Conference in June 2009.

Opening Remarks

Jonathan Zittrain gave the opening address. Striking was the prediction (from the conference organizers) that by 2013 90% of all video traffic will be video. We can expect bandwidth costs for providers will go through the roof. Jonathan point's is the the big content providers ultimately sign contracts with the big Internet service providers. The basis is: the content providers suddenly, once they become big enough, can approach the ISPs and say: your subscribers want our content - let's strike a deal. And the deal is that they don't have to have their costs sky rocket as their bandwidth goes up.

Where does that leave small providers? It's an impossible to sustain growth model.

Makes me think a lot more about varnish - a web proxy server that allows you to create a network of servers proxying static content (like video) across many different servers on different providers. As DSL and cable providers are rolling out very high bandwidth personal packages - it could provide an opportunity for our members to contribute their own home bandwidth to the organization for distributing our video bandwidth.

Free Editing Software

A new one!! pitivi. Still doesn't work for me - but the demo makes it look like the uber simple video editing software of my dreams.

DMCA Take downs

YouTomb reports that it seems like the number of YouTube videos being pulled down is going down, but in fact the truth is that they are coming down so quickly after going up that they can't track it. The average is 8 days.

In one case, a YouTube user's video was taken down after a big company used his video. YouTube assumed the big company's work was the original.

We were also entertained by Scott Smitelli's experiment with YouTube's fingerprinter. YouTube maintains a digital fingerprint database of copyright works and automatically scans uploads against this database and automatically takes them down.

Some of the conclusions about how you can fool the fingerprinter:

  • Don't bother changing metadata, title, description etc.
  • Altering pitch or speed works (as little as 3% slowdown or 4% speedup)
  • Volume changes don't work
  • Removing parts of the song works in most cases.

As for video:

  • Inverting colors works
  • Removing initial a few seconds works
  • Speedup/slow down works

Chilling Effects was mentioned as an important resource in fighting DMCA take downs.

A striking point made on a few occasions is that copyright law is causing increasing numbers of people to build private networks - a terrible trend for a public network.

HTML 5 and the video tag

Yes - it's coming! Support is coming soon in Opera, Safari, and of course Firefox. Soon, we'll be able to include streaming video in our web page by using the <video> tag just like we use the <img> tag for an image file. And, it looks like there's broad support for ogg/theora as the default encoding.

The problem, of course, is that Internet Explorer doesn't support it. How are we going to make this transition given their (still) majority share of the browser sphere?

And one last tidbid on the topic of ogg: A web site that will convert your video to ogg.

Bittorrent and pirate bay

The closing drew a comparison between the seizure of Elite Torrents in the United States, in which network admins went to jail with little or no notice among the rest of the country. In comparison, when Pirate Bay came under pressure, there were demonstrations and even a political party that jumped in to support the freedom of sharing.

Posted Sat 20 Jun 2009 05:14:26 PM EDT Tags: ga

The time has finally come.

After putting it off, I've finally started transitioning my gpg key.

I've published instructions for how to find (and sign) my new key. Thanks to dkg and micah for the help in getting this out.

If you have a gpg key, you may want to check to see if your key should be transitioned as well.

Posted Sun 10 May 2009 08:45:05 PM EDT Tags: ga

Working on tech support in Guatemala City in October 2008 for the Social Forum of the Americas is having a profound impact on my assumptions.

The Internet and all my assumptions about tech are very different in a place without regular, high speed Internet access. It's not possible to just say it's like being in New York 10 years ago, because it's not like that. The Internet I use regularly is an Internet based on an assumption that you have high speed Internet access - an assumption that didn't exist 10 years ago.

Now, I'm re-thinking everything, like when and how often I install full system upgrades, the value of having installation disks that don't need a network connection to install an operating system or program, and how our communications protocols should function if we assume inconsistent network connections rather than the opposite.

Posted Sat 09 May 2009 09:54:16 AM EDT Tags: ga

Technology, in particular the Internet, has revolutionized the use of video among progressive activists over the last 15 years. During this short span of time, the production and distribution of progressive video has moved from the domain of a small number of individuals and organizations with specialized skills and equipment to being within reach of nearly every movement activist or organization.

Despite the enormous contribution of the left toward democratizing media in general, and the influence of the left on the Internet itself, the first wave of this revolution on the Internet has corporate roots. In 2009, the ubiquity and ease with which anyone can distribute video to a large audience boils down to two develpments:

  • Common file format. After years of struggle and confusion, the flash video format (.flv) has emerged as the dominant standard for delivering video on the Internet. The emergence of a dominant file format has lead to the wide adoption of flash video enabled web browsers, relieving video producers of the need to save their videos in multiple and often confusing formats in order to ensure that their work is accessible to everyone. Flash video is a foramt created and controlled by the Adobe corporation.

  • Internet server infrastructure to distribute videos. Despite Free Speech Video's initial foray into hosting video (which was well ahead of its time), YouTube led the way for the masses to upload and share their videos. They've been followed by Blip TV and other corporations who have used their capital to finance large scale, centralized and tightly controlled spaces for activists to distribute their video files.

The second wave of this revolution is yet to come. Given the economic crisis, and the growing strength of the progressive movement both in the US and internationally, now is a critical time for the left to define and develop the next wave in video distribution.

Topics

Accessibility

Video collectives have a long history and intimate knowledge around the issue of accessibility to video. Having experienced the transitions from 3/4", to Hi-8 to MiniDV and other formats, and havig gone through the expensive and time consuming process of archiving work for future generations, video collectives have a lot to contribute toward the debate over how we should be saving our work online. Who should define the video formats we use? How do we ensure they will stay free and open?

Ownership/Control

In an era where exact duplicates of video works can easily be made, how should we define ownership of our work? How does Internet distribution affect ownership? Under what conditions should we be distributing our work?

Infrastructure

Who owns the airwaves becomes who owns the servers? How do we assert control over the means of distribution? How do we communicate this principle to our allies?

Collaboration

Groups like Paper Tiger and Indy Media have redefined the way we can make television by introducing a collaborative approach. How can we extend this idea from a small group of producers to the Internet? How can Internet distribution contribute to collaboration?

Sustainability

The corporate Internet is a graveyard of failed ideas. How can we build a distribution system that won't fail when it runs out of venture capital?

What's happening now?

There are a number of promising developments in the area of Internet/video that are relevant in this discussion.

Internet Archive. The Internet archive is a nonprofit building a library of online artifacts (including video).

Miro. Miro TV is an effort to combine a free media player with free software that aggregates existing video on the Internet, providing a "TV Guide" for leftist video on the Internet.

Engage Media. Engage Media is an activist video sharing site focused on Asia Pacific (based on Australia). They are an example of a YouTube alternative for activists.

Transmission.cc. The Transmission Network is an international coalition of groups working on online video distribution tools for social justice and media democracy.

Open Video Alliance. The Open Video Alliance seems similar in scope to the Transmission Network. They are having a conference in July in NYC.

Posted Fri 17 Apr 2009 10:18:15 AM EDT Tags: ga

I just saw an announcement on a politically smart list saying that a collaborative document was just made available on Google Docs (a web application provided by Google that allows multiple people to collaboratively edit a word processing document).

Many people are concerned about privacy in the realm of corporate services like Google Docs (Google, and anyone with legal access to Google, can read everything you post).

While I agree, I'm even more concerned about reliability. I don't believe we should count on services provided by corporations (or corporations themselves) being around for the long haul and we certainly can't count on them to gracefully close. When capitalism is doing well, corporations are purchased, merged, and re-organized with unpredictable changes in the quality or future of services. In times like the present, corporations slash services or just go belly up. And regardless of the economic climate, network access to corporate services can be turned off in an instant in response to any number of spurious copyright complaints or politically motivated criminal investigations.

What happens to our library of documents when this happens? Can we count on a warning that would allow us to retrieve our data?

You could argue that Google is one of the most financially powerful institutions on the Internet and is therefore highly unlikely to be bought or go belly up. Yet, do we really want to hitch our political movements to the financial success of a corporation whose intent is to dominate the Internet? Do we want to support a practice that will, over time, make us increasingly interdependent on Google?

Fortunately, there are alternatives. "Alternative" in this sense doesn't mean a nonprofit or other entity offering the same services as Google Docs (yet another unreliable data silo), but instead alternative in the real sense of the word.

The project is called oo2gd (OpenOffice to Google Docs). It allows you to synchronize your documents from OpenOffice, a free office suite, to Google Docs (and several other network platforms). With oo2gd you can use Google Docs while always preserving, off line on your own computer, copies of your work.

Posted Tue 10 Feb 2009 09:32:31 AM EST Tags: ga

One of the best conferences in New York City is looking for fresh volunteers! Anyone who feels strongly not just about grassroots media but about broad based progressive organizing should consider helping out. For more information about the project (if you are not already familiar with it) - you can checkout their website.

Here's the call for the volunteers:

CALL FOR PARTICIPATION: Sixth Annual NYC Grassroots Media Conference!

Host: NYC Grassroots Media Coalition
Date:Wednesday, January 14, 2009
Time:7:00pm - 8:00pm
Location:NACLA office
Street:38 Greene Street, 4th floor (corner of Grand Street), SoHo

Come out and help organize the most important media gathering in NYC! Get to
know grassroots media makers and social justice organizers from around the
city while working to change our city's media landscape. Network, learn
about media, and make friends!

We're looking for people to join our core organizing team. Starting in
January, you'll work closely with staff and other organizers to make this
the most diverse and exciting GMC yet. We particularly need people with
event organizing, design, and web skills, but we welcome everyone. So come &
learn about the organizing process and meet the rest of the group.
The NYC Grassroots Media Conference organizing committee actively seeks
participation from different ethnic and racial backgrounds, sexual
orientations, classes, and physical abilities.

Phone: 8023098146
Email: jbatten517@gmail.com
Posted Tue 06 Jan 2009 05:10:47 PM EST Tags: ga

Thanks for the work of May First/People Link member AWAAM, I've been following the story of Khalil Gibran International Academy, a school that opened in 2007 in Brooklyn to serve as a dual-language Arabic/English school where a mixed group of Arabic speakers and non-Arabic speakers would learn together.

The story of the school's opening and the original principal getting pushed out because she acknowledged that "intifada" was a word with meaning and history is tragic. However, that was just the beginning. Seth Wessler has written an article documenting the continued impact of a conservative campaign to undermine the school with the latest twist: pictures of mosques being cut out of the text books.

Posted Thu 04 Dec 2008 10:04:44 AM EST Tags: ga

On Wednesday, November 12, a collaboration of activists and pranksters distributed a remarkably high quality spoofed copy of the New York Times along with an equally artful website.

The reaction was phenomenal. News of the project was forwarded, blogged, discussed, txt'ed; subjected to rants and raves; and picked up by news organizations all over the world.

The server hosting the website, run by May First/People Link members The Yes Men got slammed. Almost immediately. And, was practically unreachable for the first day.

By the next day, the website was being distributed over four servers in three locations (later extended to six servers in six locations) and was being supported by activist techies spanning close to a half dozen radical tech collectives throughout North America, including May First/People Link, Riseup, Indymedia, Koumbit, Guerillartivism and more. And, the site was delivering page views faster than anyone expected.

What happened? How was this turn-around possible?

Day 0

Before this idea was even born, The Yes Men chose to host with a politically progressive provider, not a corporate provider. This step is one of the most crucial steps any politically focused organization can choose. Here are a few reasons why:

  • Activist providers have more resources. This assertion sounds counter-intuitive to the way we think about the left and capitalism - we're used to being in situations where the left is under-resourced and the capitalists are awash in venture capital funding. However, when it comes to the Internet, hardware/capital is only one of many resources we need. Labor, particularly highly skilled labor available on a moment's notice is far more critical. And activists providers are impressively organized with high caliber skills. Furthermore, the hardware costs are increasingly coming down to a point where even under-financed activist groups can afford them. And finally, in case you haven't noticed, venture capital is waning these days. Really. Waning.

  • Activist providers are more flexible. We're used to calling our corporate service providers and getting someone on the phone relatively quickly. That's great. Except the person we get on the phone usually knows less than we do and has no power or authority to do anything. Activist providers don't have the resources to be on call 24/7, but once we got on a problem, we have the flexibility, authority, and knowledge to help. Furthermore, we have the ability to call in our networks to bring in resources beyond our organization.

  • Activist providers actually want you to get more traffic so that you'll win. We experience a lot of strange hand-wringing from our members over what happens if we get a lot of traffic. That's understandable since commercial providers want you to get more traffic so that they can charge you more. Activist providers want you to get more traffic so that you'll win. Most of the activist providers who stepped in to support the Yes Men will be getting higher than usual bandwidth bills this month. Although we're all strapped for cash, this is a good thing and the very reason why we exist.

  • Activist providers extend the organizing project to the Internet. By choosing an activist provider, the Yes Men made a conscious and active decision to share their success with the radical tech movement. We're stronger as a result, meaning the next time we have a similar situation with another site or another group, we will be that much more prepared and ready thanks to this decision by the Yes Men.

By hosting with an activist provider, the project had a different level of access to the network of people and organizations that eventually made the site sing.

Day 1

The site, which is running a free content management system called WordPress, is on a mostly dedicated, very powerful server (4 processors, 4 GB of RAM). Nonetheless, by the middle of day one the server was on it's knees.

When the server went into overload, we immediately created an Internet chat room open to the public to help figure out how to get the site up and running. Although the handful of people working on the server were able to make small improvements, the real change happened when we were joined by our allies from Riseup and the network of tech activists they had access to. May First/People link has at our disposal two dozen machines in 5 locations around the country and an impressively skilled tech team. When we were joined by our allies, the resources at our disposable (directly and indirectly by our ability to grow even larger) became incalculable.

We spent the next several hours setting up caching servers around the country to reduce the load on the primary server. We experienced a lot of serious technical hurdles in the process, however, between the half dozen techies involved, we were able to declare success at 1:30 am. We experienced a few blips and minor problems, however, for the most part, the site was being successfully server to everyone who came.

Day 2

The next day we all monitored the site and the caching servers, eventually increasing the number of servers involved roe 4 to 6. We experienced a few minor problems, however, the site worked so well that conversation on the chat channel turned to brain storming new content to add.

Lessons Learned

"If we could do it over again" is a common refrain on all projects and this one is no exception.

It is very difficult to predict success and even harder to predict server load of a successful project, since every year the numbers of people who might view our site changes along with the software and hardware we use to power the site. At May First/People Link we have members predicting huge spikes that never materialize, while at the same time experiencing spikes they had no idea were coming. Nonetheless, with more advance warning, we could have had the caching network in place for the day of the launch. Additionally, we should have put a call out to our network for help immediately, which may have resulted in the caching system setup happening earlier on the first day.

For obvious reasons, the project chose to use the commercial DNS provider joker.com to host their domain name so that if anyone queried who was handling their domain name, the query would return:

a.ns.joker.com b.ns.joker.com c.ns.joker.com d.ns.joker.com

Yes, irresistible.

However, since the domain name was under the control of a corporation, not one of our allies, we were unable to properly control how long an IP address was assigned to the domain name nytimes-se.com. This lack of fine grained control made if difficult to switch to the caching system we had in place, and made it difficult to remove mis-configured caching servers.

Technical details

For the technically curious, below is a brief synopsis of what we did.

Our first move was to install and enable the WordPress supercache. For a while we thought it was broken because we experienced a lot of Redirect errors:

Request exceeded the limit of 10 internal redirects due to probable
configuration error. Use 'LimitInternalRecursion' to increase the limit if
necessary. Use 'LogLevel debug' to get a backtrace., referer:
http://www.nytimes-se.com/nytse/wp-content/themes/nytimes/style.css

However, we later realized that the errors were caused by an errant .htaccess file one directory up from the root directory.

Next we worked on getting the right number of MaxClients set in the Apache configuration. Too many clients and the server load sky rocketed. Too few clients and the server would start refusing connections. After a lot of back and forth we settled on 256.

Also, the following sysctl parameters were changed from 60 to 15 and from 7200 to 1800 respectively:

/proc/sys/net/ipv4/tcp_fin_timeout
/proc/sys/net/ipv4/tcp_keepalive_time

Next we tried to off load some of the large files (a few pdfs and mov files). After struggling for too long trying to get a fancy ModRewrite to work that would have allowed load balancing between multiple servers, we just put in a RedirectTemp to a single server.

Finally, we moved the database driving the WordPress site to another server.

For a few extra CPU cycles, we temporarily turned off two services: munin, and cron.

Despite all of these efforts, we were hitting loads of up to 170 and nobody could access the site.

We next worked on what appeared to be some WordPress rewrite rules going awry, which may have been contributing to the load problems (loops and loops and loops). At the same time we started setting up Squid proxy servers to help balance the load. Between the pool of techies working on the project, we got four squid servers up and running very quickly.

The next period was the most frustrating. It was really hard to trouble shoot the rewrite/looping rules after we had the proxy system in place - we couldn't tell if the looping was caused by the proxy setup or was an undetected error prior to moving to the proxy setup.

Eventually, we stopped the loops with a one line WordPress plugin.

However, Squid and WordPress still gave us problems. They simply do not seem to get along very well (specifically - Squid re-writes http requests that is passes back to WordPress in a way that WordPress cannot handle). After hours and hours of trouble shooting, a brilliant 1:00 am suggestion was made: let's switch to varnish (an alternative caching server). Varnish was setup in a matter of minutes (much simpler to configure) and worked extremely well. In the end, we got three varnish servers up and running.

The stats

A look at the stats is quite sobering. Normally, in our colo center in Telehouse, our combined membership uses just under 10 Mbits. Below is the graph for just the nytimes-se.com server:

nytse.png

And here are statistics for just one of the caching servers:

cache.png

The offline world

Fortunately, thanks to some members of the Rude Mechanical Orchestra (and many many others) there were other methods for people to access the paper:

paperboys.jpg

Posted Wed 12 Nov 2008 07:10:53 PM EST Tags: ga