Podcasting 2.0 – Evolution of Podping

The beginning

<p dir="auto">For just <a href="https://write.agates.io/podcasting-2-0-the-last-mile" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">under a year, Podping has been available and in use -- through dedicated podcast hosting companies and also self-hosting individuals -- to efficiently notify interested parties of updates to RSS feeds that define podcasts. <p dir="auto">It was a bit rocky in the beginning, mostly because understanding the design simplicity offered by a decentralized message bus and defining a software interface to write to it efficiently are two different tasks. But it worked all along and we largely got through it without incident, thanks to the transparency and resiliency of the Hive blockchain. <p dir="auto">Unfortunately, since it's on a blockchain, some of the initial experiments proving out the concept of the project at large are still around. One of the most important concepts of a project like this is people can depend on a defined schema, even if it's implemented in a schemaless manner (JSON). <p dir="auto">Learning to communicate intent of the Podping project overall was helped by collaborating and putting out a stable release. The 1.0 release of <a href="https://github.com/Podcastindex-org/podping-hivewriter" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">podping-hivewriter, the current primary software we use to manage writing "podpings" to the Hive blockchain, came out several months after the original vision of the project had been laid down in a lowly <a href="https://noagendatube.com/videos/watch/aa312c55-4c26-4c76-b9ca-4e59737f0c8c" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">Podcasting 2.0 developer roundtable. <h2>Intent <p dir="auto">While a stable release contributed to our understanding the stability of the system, we had only just begun to realize the potential we had beyond merely a simple podcast update system. <p dir="auto">After all, the original scope of Podping was to help reduce unnecessary polling of RSS feeds when they had no change in content. We had already accomplished this by allowing anyone to announce the following data on the blockchain within a given a "podping" event: <pre><code>{ "version": "0.3", "num_urls": 1, "reason": "feed_update", "urls": ["https://example.com/super-great-pod.xml"], } <p dir="auto">Simple! This tells a user that an update to the RSS feed that defines a fictitious "super great pod" podcast occurred. <p dir="auto">This alone is already more valuable than it would first appear. Not only can one reasonably assume they can stop polling feeds that get submitted via Podping; they also automatically obtain access to an entire history of podcasts. Without compromise. <p dir="auto">That would be enough for most people. <h2>Evolution <p dir="auto">But a few things had happened since the Podping project had been started. <p dir="auto">While the Podcasting 2.0 community had largely agreed that the movement was for <a href="https://write.agates.io/podcasting-2-0-more-than-podcasts" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">more than podcasts, no one really understood how to make that work. <p dir="auto">Eventually, I had postulated that the easiest way to do this was to <a href="https://write.agates.io/podcasting-2-0-when-semantics-matter" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">tell the consumer and shortly after wrote the <a href="https://github.com/Podcastindex-org/podcast-namespace/issues/263" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link"><podcast:medium> specification which was eventually <a href="https://github.com/Podcastindex-org/podcast-namespace/blob/main/docs/1.0.md#medium" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">finalized in The Podcast Namespace. <p dir="auto">In parallel, the Podcasting 2.0 community had been throwing around <a href="https://github.com/Podcastindex-org/podcast-namespace/issues/212" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">ways to formalize live streams within RSS feeds. <p dir="auto">Coincidentally, both had been finalized in <a href="https://github.com/Podcastindex-org/podcast-namespace#phase-4-closed-on-1212021" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">Phase 4. It just so happens that <em>the type of the live stream depends on the medium. <p dir="auto">Our intent had evolved. <p dir="auto">Since the intention of having a medium is to tell the consumer, and it's to be expected that <em>not all consuming applications will care about all types of mediums, we had decided it was important enough to include in the basic event types of Podping. <p dir="auto">We had also realized decentralized live feeds weren't of much use to anyone without the ability to instantly notify consumers <em>when a live feed actually starts with an indication of priority <em>beyond normal feed updates. <h2>podping-hivewriter version 1.1 <p dir="auto">Given the above information, in addition of some new context about how the particularities of how Hive functions internally, we <a href="https://github.com/Podcastindex-org/podping-hivewriter/issues/18" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">made the decision as a team to improve upon the Podping events by including the above metadata directly in the event names (known as operation IDs in Hive). <p dir="auto">These event names are changing from <code>podping to the format of <code>pp_{medium}_{reason}, prefixed with <code>pp_ to denote podping. <p dir="auto">Where <code>{medium} can be one of, as of this time of writing, the following: <ul> <li><code>podcast <li><code>music <li><code>video <li><code>film <li><code>audiobook <li><code>newsletter <li><code>blog <p dir="auto">And <code>{reason} can be one of, as of this time of writing, the following: <ul> <li><code>update <li><code>live <p dir="auto">Importantly, the podping-hivewriter project will default to the <code>podping medium and <code>update reason to remain compatible with the current scope of users. Official documentation for the above reasons and their meaning will be available on the podping-hivewriter Github project by the time 1.1 stable is released. <p dir="auto">One may replace the <code>pp_ prefix with <code>pplt_ for "podping livetest," which is what we use during development and continuous integration of the podping-hivewriter project. You can use these "livetest" events to test these changes as a consumer before anyone officially adopts them. <h2>Definition <p dir="auto">In addition to the event name changes above, we also decided to change the on-chain Podping format to continue to communicate intent. <p dir="auto">In short, the new schema will use version "1.0" to help compatibility and is defined as follows: <pre><code>{ "version": "1.0", "medium": "<ex: podcast>", "reason": "<ex: update>", "iris": ["list", "of", "iris"], } <p dir="auto">Most noticeably, <code>urls is being changed to <code>iris. This indicates given RSS feeds can be identifiers besides HTTP URLs -- perhaps IPFS CIDs or magnet links, for example -- and the character set is "internationalized," supporting any UTF-8 character. Note that this has been assumed by podping-hivewriter since the 1.0 initial release and this is merely a name change. <p dir="auto">The addition of the <code>medium and <code>reason slugs to this schema is primarily for portability of data and flexibility of filtering. It is redundant to have it both in the schema and the event name, and that is intentional. <p dir="auto">Given the above additions, it's safe to say the following definition of Podping holds true and is identified by the intent of the given data: <blockquote> <p dir="auto">Podping is a mechanism of using decentralized communication to relay notification of updates of RSS feeds that use The Podcast Namespace. It does so by supplying minimum relevant metadata to consumers to be able to make efficient and actionable decisions, allowing them to decide what to do with given RSS feeds without parsing them ahead of time. <h2>Looking forward <p dir="auto">We have some more ideas to expand upon the Podping update reasons listed above. However, many of these will require new Podcast Namespace features as <a href="https://github.com/Podcastindex-org/podcast-namespace/blob/main/proposal-docs/podping/podping.md" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">outlined here by Brian of London. <p dir="auto">For example, we want to be able to allow hosts to use Podping as a way to tell consumers when a feed is changing hosts. In order to prevent abuse, we want to be able to tell consumers to expect this type of event to come from a known Hive account set within the RSS feed. <p dir="auto">After all, feeds already get polled to oblivion. Anyone announcing a feed update via podping is relatively harmless, even if it's not their feed. A host change, on the other hand, is another story altogether. We are trying to be cognizant of that for new features. <p dir="auto">The <code><podcast:podping> proposal also allows consumers to actually know when a feed is set to update via Podping, as opposed to guessing, helping to remove ambiguity. <h2>Conclusion <p dir="auto">In the last year we've turned the Podping project around from an experiment that happens to work well to a full-fledged project with defined scope. <p dir="auto">Podping doesn't just send URLs around to applications in hope that they know what to do with them, nor to funnel a user into clicking on something. It provides context as to why they were sent and how relevant the changes are to applications. <p dir="auto">Because we don't need new ways to send people URLs. People have been trying that for the last 16 years. <p dir="auto"><em><span>Reposted from <a href="https://write.agates.io/podcasting-2-0-evolution-of-podping" target="_blank" rel="noreferrer noopener" title="This link will take you away from hive.blog" class="external_link">https://write.agates.io/podcasting-2-0-evolution-of-podping