<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Productivity on kenji.blog</title><link>http://kenji.blog/en/tags/productivity/</link><description>Recent content in Productivity on kenji.blog</description><generator>Hugo -- gohugo.io</generator><language>en</language><copyright>kenjinote</copyright><lastBuildDate>Sat, 12 Sep 2026 12:00:00 +0900</lastBuildDate><atom:link href="http://kenji.blog/en/tags/productivity/index.xml" rel="self" type="application/rss+xml"/><item><title>Remote Work and Return to Office: What is the Optimal Solution for Engineers?</title><link>http://kenji.blog/en/p/remote-vs-rto-engineers/</link><pubDate>Sat, 12 Sep 2026 12:00:00 +0900</pubDate><guid>http://kenji.blog/en/p/remote-vs-rto-engineers/</guid><description>&lt;img src="http://kenji.blog/p/remote-vs-rto-engineers/img/eyecatch.jpg" alt="Featured image of post Remote Work and Return to Office: What is the Optimal Solution for Engineers?" />&lt;h1 id="introduction-the-post-pandemic-paradigm-shift-and-the-wave-of-rto">Introduction: The Post-Pandemic Paradigm Shift and the Wave of RTO
&lt;/h1>&lt;p>The global pandemic of the early 2020s fundamentally overturned the definition of a &amp;ldquo;workplace&amp;rdquo; in the software engineering industry. Overnight, offices were locked down, and almost all companies—from Silicon Valley tech giants to Japanese startups—were forced into a mandatory transition to full remote work. This historic social experiment shattered the long-held stereotype among management that &amp;ldquo;advanced software development is impossible without gathering in an office,&amp;rdquo; and proved that geographically distributed teams can build and operate massive systems by leveraging tools like GitHub, Slack, Zoom, and Notion.&lt;/p>
&lt;p>However, as the pandemic subsides, the industry landscape is transforming once again. Tech giants like Amazon, Google, and Meta have begun strongly pushing for a &amp;ldquo;hybrid model&amp;rdquo; that mandates several days of office attendance a week, or even a full &amp;ldquo;Return to Office (RTO).&amp;rdquo; This top-down RTO directive from management is creating severe friction with many engineers (Individual Contributors: ICs). While engineers argue that &amp;ldquo;a quiet home environment allows for better focus on code&amp;rdquo; and &amp;ldquo;commuting time is a waste of life,&amp;rdquo; management counters that &amp;ldquo;innovation is born from serendipitous encounters&amp;rdquo; and &amp;ldquo;face-to-face communication is essential for fostering organizational culture.&amp;rdquo;&lt;/p>
&lt;p>In this article, we will not dismiss this binary debate of &amp;ldquo;Remote Work vs. Return to Office&amp;rdquo; as mere emotional arguments or matters of personal preference. Instead, we will thoroughly dissect it through the objective and technical lenses of organizational sociology, quantitative evaluation of engineering productivity (DORA metrics, SPACE framework), and underlying network architecture (VPN and Zero Trust). Let&amp;rsquo;s explore the &amp;ldquo;true optimal solution&amp;rdquo; that modern engineering organizations should aim for regarding this complex issue at the intersection of technology and human society.&lt;/p>
&lt;hr>
&lt;h1 id="unraveling-the-dynamics-of-communication-through-organizational-sociology">Unraveling the Dynamics of Communication through Organizational Sociology
&lt;/h1>&lt;p>Software development is both a highly intellectual task and an extremely social activity. In the process of dozens or hundreds of engineers collaborating to build a massive system, the quality and quantity of communication become the most significant factors determining the success or failure of a project. Here, we analyze the impact of remote work on communication using classical theories of organizational sociology.&lt;/p>
&lt;h2 id="the-allen-curve-and-the-curse-of-physical-distance">The Allen Curve and the Curse of Physical Distance
&lt;/h2>&lt;p>In the late 1970s, Professor Thomas J. Allen of the Massachusetts Institute of Technology (MIT) investigated the relationship between the frequency of communication among engineers in R&amp;amp;D organizations and their physical distance within the office. The resulting finding is the famous &amp;ldquo;Allen Curve.&amp;rdquo;&lt;/p>
&lt;p>According to Allen&amp;rsquo;s research, the probability of communication occurring between engineers decays exponentially as physical distance increases. This relationship can be approximately expressed by the following mathematical model:&lt;/p>
$$ P(d) \approx \alpha e^{-\beta d} $$&lt;p>Here, $P(d)$ is the probability of communication occurring, $d$ is the physical distance between two engineers, and $\alpha$ and $\beta$ are constants that depend on the organization&amp;rsquo;s culture and environment.&lt;/p>
&lt;p>The most shocking fact revealed by the Allen Curve is that &amp;ldquo;when the distance exceeds 30 meters, the probability of daily communication rapidly approaches zero.&amp;rdquo; Information exchange happens overwhelmingly more with a colleague at the next desk than with a colleague on a different floor of the same building.&lt;/p>
&lt;pre class="mermaid">
graph LR
D0[&amp;#34;Distance: 0m (Next desk)&amp;#34;] --&amp;gt; P0[&amp;#34;Face-to-face communication probability: Extremely high&amp;#34;]
D10[&amp;#34;Distance: 10m (Same cluster)&amp;#34;] --&amp;gt; P10[&amp;#34;Face-to-face communication probability: High&amp;#34;]
D30[&amp;#34;Distance: 30m (Different floor)&amp;#34;] --&amp;gt; P30[&amp;#34;Face-to-face communication probability: Low (few %)&amp;#34;]
DRemote[&amp;#34;Full remote (Different city)&amp;#34;] --&amp;gt; PRemote[&amp;#34;Serendipitous synchronous communication probability: Almost zero&amp;#34;]
D0 -. Rapid decay of the Allen Curve .-&amp;gt; D10
D10 -. Loss of physical proximity .-&amp;gt; D30
D30 -. Shift to completely asynchronous/intentional communication .-&amp;gt; DRemote
&lt;/pre>
&lt;p>In a full remote work environment, this physical distance $d$ becomes effectively infinite. In other words, even with the existence of Slack or Zoom, serendipitous communication (like &amp;ldquo;water cooler talk&amp;rdquo;) structurally ceases to occur. One of the strongest rationales for management to push for RTO is to reclaim this &amp;ldquo;sharing of tacit knowledge and creation of innovation brought about by physical proximity,&amp;rdquo; backed by the Allen Curve.&lt;/p>
&lt;h2 id="conways-law-and-its-impact-on-architecture">Conway&amp;rsquo;s Law and Its Impact on Architecture
&lt;/h2>&lt;p>Another indispensable theory when considering remote work is &amp;ldquo;Conway&amp;rsquo;s Law,&amp;rdquo; proposed by Melvin Conway in 1968.&lt;/p>
&lt;blockquote>
&lt;p>&amp;ldquo;Organizations which design systems are constrained to produce designs which are copies of the communication structures of these organizations.&amp;rdquo;&lt;/p>
&lt;/blockquote>
&lt;p>Full remote work fundamentally changes an organization&amp;rsquo;s communication structure. Dense face-to-face collaboration decreases, and asynchronous, formal communication via Slack channels and Jira tickets takes precedence. As a result, boundaries between teams (silos) become stronger.&lt;/p>
&lt;pre class="mermaid">
graph LR
subgraph &amp;#34;Organization Communication Structure (Under Remote Environment)&amp;#34;
FE[&amp;#34;Front-end Team (Siloed)&amp;#34;]
BE[&amp;#34;Back-end Team (Siloed)&amp;#34;]
DB[&amp;#34;Database Team (Siloed)&amp;#34;]
FE -. &amp;#34;Asynchronous integration via API docs (Swagger)&amp;#34; .- BE
BE -. &amp;#34;Schema change requests via Jira tickets&amp;#34; .- DB
end
subgraph &amp;#34;System Architecture&amp;#34;
SPA[&amp;#34;SPA (React)&amp;#34;]
API[&amp;#34;API Gateway / Microservices&amp;#34;]
Data[&amp;#34;Database (PostgreSQL)&amp;#34;]
SPA --&amp;gt; API
API --&amp;gt; Data
end
FE === SPA
BE === API
DB === Data
&lt;/pre>
&lt;p>This siloing is not necessarily a bad thing. When adopting a microservices architecture with clear API interfaces and independent deployability, intentionally restricting communication between teams to increase their independence is sometimes even recommended as an &amp;ldquo;Inverse Conway Maneuver.&amp;rdquo; Full remote work can be said to be suitable for developing loosely coupled systems with clear boundaries.&lt;/p>
&lt;p>However, during the initial launch phase of a system (zero-to-one development), large-scale refactoring spanning multiple components, or troubleshooting unknown incidents, dense and high-bandwidth communication across team boundaries is essential. Excessive siloing in a remote environment makes solving such monolithic challenges extremely difficult.&lt;/p>
&lt;hr>
&lt;h1 id="redefining-engineering-productivity-quantification-via-dora-and-space">Redefining Engineering Productivity: Quantification via DORA and SPACE
&lt;/h1>&lt;p>Which has higher &amp;ldquo;productivity,&amp;rdquo; remote work or office attendance? The reason this debate often ends in a stalemate is because the definition of the word &amp;ldquo;productivity&amp;rdquo; is ambiguous. The era of measuring productivity by lines of code (LOC) or the number of pull requests is over. In modern engineering organizations, productivity is evaluated from multiple angles using DORA metrics and the SPACE framework.&lt;/p>
&lt;h2 id="the-impact-of-remote-work-through-the-lens-of-dora-metrics">The Impact of Remote Work through the Lens of DORA Metrics
&lt;/h2>&lt;p>The four key metrics defined by the DevOps Research and Assessment (DORA) team have become the industry standard for measuring software delivery speed and stability.&lt;/p>
&lt;ol>
&lt;li>&lt;strong>Deployment Frequency&lt;/strong>&lt;/li>
&lt;li>&lt;strong>Lead Time for Changes&lt;/strong>&lt;/li>
&lt;li>&lt;strong>Change Failure Rate&lt;/strong>&lt;/li>
&lt;li>&lt;strong>Mean Time To Recovery (MTTR)&lt;/strong>&lt;/li>
&lt;/ol>
&lt;p>According to much empirical data, in a full remote environment, teams centered around senior engineers tend to see improvements in &amp;ldquo;Deployment Frequency&amp;rdquo; and &amp;ldquo;Lead Time for Changes.&amp;rdquo; This is because office-specific interruptions (a tap on the shoulder, being pulled into a sudden meeting) disappear, making it easier to enter a state of &amp;ldquo;deep work&amp;rdquo; (deep concentration).&lt;/p>
&lt;p>On the other hand, there is concern about the negative impact on &amp;ldquo;Mean Time To Recovery (MTTR).&amp;rdquo; When a complex system failure occurs, incident response requires simultaneous investigation and swift decision-making by multiple domain experts. MTTR can be expressed by the following equation:&lt;/p>
$$ MTTR = \frac{1}{N} \sum_{i=1}^{N} (t_{restore, i} - t_{incident, i}) $$&lt;p>In an office, key members can be gathered in a &amp;ldquo;war room,&amp;rdquo; rapidly cycling through hypothesis testing while surrounding a whiteboard. However, in a full remote environment, overhead occurs: issuing a Zoom link, gathering the appropriate members on Slack, and proceeding while checking logs via screen sharing. In this &amp;ldquo;synchronous emergency response,&amp;rdquo; physical proximity remains a powerful weapon.&lt;/p>
&lt;h2 id="the-space-framework-a-multifaceted-evaluation-of-developer-experience">The SPACE Framework: A Multifaceted Evaluation of Developer Experience
&lt;/h2>&lt;p>While DORA focuses on system output, the SPACE framework, proposed by researchers at GitHub and Microsoft, captures the Developer Experience (DX) more comprehensively.&lt;/p>
&lt;pre class="mermaid">
mindmap
root((&amp;#34;SPACE Framework&amp;#34;))
S((&amp;#34;Satisfaction &amp;amp; Well-being&amp;#34;))
S1[&amp;#34;Elimination of commute stress (Remote advantage)&amp;#34;]
S2[&amp;#34;Isolation &amp;amp; burnout (Office advantage)&amp;#34;]
P((&amp;#34;Performance&amp;#34;))
P1[&amp;#34;Value delivery to customers&amp;#34;]
P2[&amp;#34;Code quality&amp;#34;]
A((&amp;#34;Activity&amp;#34;))
A1[&amp;#34;Number of PRs created&amp;#34;]
A2[&amp;#34;Deployment frequency&amp;#34;]
C((&amp;#34;Communication &amp;amp; Collaboration&amp;#34;))
C1[&amp;#34;Review speed&amp;#34;]
C2[&amp;#34;Sharing of tacit knowledge (Office advantage)&amp;#34;]
E((&amp;#34;Efficiency &amp;amp; Flow&amp;#34;))
E1[&amp;#34;Fewer context switches (Remote advantage)&amp;#34;]
E2[&amp;#34;Elimination of interruptions (Remote advantage)&amp;#34;]
&lt;/pre>
&lt;p>Using the SPACE framework, the light and shadow of remote work become clear. While a remote environment maximizes an engineer&amp;rsquo;s &amp;ldquo;Efficiency &amp;amp; Flow,&amp;rdquo; it carries the risk of hindering &amp;ldquo;Communication &amp;amp; Collaboration.&amp;rdquo; Furthermore, regarding &amp;ldquo;Satisfaction,&amp;rdquo; while there is the positive aspect of eliminating the commute, there is also the negative aspect of deteriorating mental health due to social isolation.&lt;/p>
&lt;hr>
&lt;h1 id="the-cost-and-cognitive-load-of-asynchronous-communication">The Cost and Cognitive Load of Asynchronous Communication
&lt;/h1>&lt;p>The key to successful full remote work lies in the transition from &amp;ldquo;synchronous communication&amp;rdquo; (meetings, hallway chats) to &amp;ldquo;asynchronous communication&amp;rdquo; (documents, tickets, chats). Fully remote pioneering companies like GitLab and Automattic achieve this through a thorough documentation culture. However, over-reliance on asynchronous communication creates another kind of &amp;ldquo;cost.&amp;rdquo;&lt;/p>
&lt;h2 id="the-context-switching-trap-brought-by-slack-and-jira">The Context-Switching Trap Brought by Slack and Jira
&lt;/h2>&lt;p>A problem that would be solved with a few seconds of chatting in the office transforms into a long Slack thread or a rally on Jira when working remotely. The number of communication paths within a team, where the number of members is $n$, is the number of edges in a complete graph expressed by the following formula:&lt;/p>
$$ C = \frac{n(n-1)}{2} $$&lt;p>As an organization grows, the volume of asynchronous messages flying across these communication paths increases explosively. Engineers find themselves continuously processing incoming notifications (with $S_i$ as the switch cost and $R_i$ as the response cost) alongside tasks requiring deep concentration like coding ($E_{task}$). The total cognitive load ($E_{total}$) swells as follows:&lt;/p>
$$ E_{total} = E_{task} + \sum_{i=1}^{k} (S_i + R_i) $$&lt;p>Asynchronous communication saves the sender&amp;rsquo;s time (they can send it anytime), but in return, it forces the receiver to bear the load of deciphering and reconstructing the context. It is extremely difficult to accurately convey complex system specifications or design intentions using only text, which often results in misunderstandings and rework.&lt;/p>
&lt;h2 id="the-synchronous-value-of-whiteboard-sessions">The Synchronous Value of Whiteboard Sessions
&lt;/h2>&lt;p>In initial architecture design or discussions of complex algorithms, the synchronous activity of &amp;ldquo;gathering around a whiteboard&amp;rdquo; possesses unparalleled information bandwidth. While online collaboration tools like Miro and Figma have evolved dramatically, they have not yet completely replaced physical interactions accompanied by human gestures, eye movements, and the act of &amp;ldquo;drawing and explaining right there.&amp;rdquo; It must be said that the physical office still holds high value in the process of synchronously sharing and constructing high-dimensional abstract concepts.&lt;/p>
&lt;hr>
&lt;h1 id="the-technological-foundation-supporting-remote-work-from-the-limits-of-vpn-to-zero-trust">The Technological Foundation Supporting Remote Work: From the Limits of VPN to Zero Trust
&lt;/h1>&lt;p>So far, we have discussed this from the perspectives of sociology and productivity, but another crucial factor determining the remote work experience is &amp;ldquo;network architecture.&amp;rdquo; An engineer&amp;rsquo;s productivity is directly linked to the access latency of the development environment and production servers.&lt;/p>
&lt;h2 id="traditional-vpn-architecture-and-the-mathematics-of-latency">Traditional VPN Architecture and the Mathematics of Latency
&lt;/h2>&lt;p>Early in the pandemic, many companies hastily scaled up their traditional VPN (Virtual Private Network) gateways to provide remote access to their existing on-premises environments. However, this perimeter-based defense architecture becomes a fatal bottleneck in the era of remote work.&lt;/p>
&lt;p>The total network latency $T_{total}$ is expressed as the sum of propagation delay (dependent on physical distance), transmission delay (dependent on bandwidth), and processing delay at routers and gateways.&lt;/p>
$$ T_{total} = \frac{D}{c} + \frac{L}{B} + T_{proc} $$&lt;p>When using a traditional VPN, even when a remote engineer accesses cloud-based SaaS (like GitHub or the AWS console), an inefficient routing called &amp;ldquo;Hairpinning (Hairpin NAT)&amp;rdquo; occurs, where all traffic is pulled into the corporate network&amp;rsquo;s VPN gateway before exiting to the internet. This unnecessarily increases the distance $D$ and causes the encryption/decryption processing delay $T_{proc}$ of the VPN appliance to skyrocket. This significantly degrades the response of an engineer&amp;rsquo;s typing, destroying their state of flow.&lt;/p>
&lt;h2 id="the-paradigm-shift-brought-by-zero-trust-beyondcorp">The Paradigm Shift Brought by Zero Trust (BeyondCorp)
&lt;/h2>&lt;p>Breaking through these network limitations and realizing a true &amp;ldquo;environment where you can work comfortably and securely from anywhere&amp;rdquo; is the &lt;strong>Zero Trust Network Architecture (ZTNA)&lt;/strong>, pioneered by Google&amp;rsquo;s &amp;ldquo;BeyondCorp.&amp;rdquo;&lt;/p>
&lt;p>The core of Zero Trust is &amp;ldquo;not using the network perimeter (whether internal or external) as the basis of trust.&amp;rdquo;&lt;/p>
&lt;pre class="mermaid">
graph TD
subgraph &amp;#34;Perimeter Defense Model (Traditional VPN)&amp;#34;
U1[&amp;#34;Remote Engineer&amp;#34;] -- IPsec / SSL VPN --&amp;gt; VPN[&amp;#34;VPN Gateway (Single Point of Failure / Bottleneck)&amp;#34;]
VPN -- Internal LAN (Implicit Trust) --&amp;gt; App1[&amp;#34;Internal Source Code Management&amp;#34;]
end
subgraph &amp;#34;Zero Trust Model (BeyondCorp / ZTNA)&amp;#34;
U2[&amp;#34;Remote Engineer (MDM Managed Device)&amp;#34;] -- Direct Communication (mTLS HTTPS) --&amp;gt; IAP[&amp;#34;Identity-Aware Proxy (IAP)&amp;#34;]
IAP -- Dynamic Authorization per Request --&amp;gt; App2[&amp;#34;Internal / SaaS Applications&amp;#34;]
IDP[&amp;#34;Identity Provider (Okta / Entra ID)&amp;#34;] -. MFA / User Context .-&amp;gt; Policy
MDM[&amp;#34;Device Management (Intune / Jamf)&amp;#34;] -. Device Health (Patch Status) .-&amp;gt; Policy
Policy[&amp;#34;Access Policy Engine&amp;#34;] -. Risk-based Authorization Decision .-&amp;gt; IAP
end
&lt;/pre>
&lt;p>In a Zero Trust architecture, there are no centralized chokepoints like VPNs. Whether from a home Wi-Fi network or a public cafe LAN, engineers access each resource directly through the shortest path via an Identity-Aware Proxy (IAP), based on strong contexts of device authentication (such as client certificates) and user authentication (MFA).&lt;/p>
&lt;p>As a result, the unnecessary distance $D$ and excessive processing delay $T_{proc}$ in the aforementioned latency equation are eliminated, enabling terminal operations and massive data transfers with extremely low latency, entirely comparable to being in the office. The state where &amp;ldquo;productivity does not drop even when remote&amp;rdquo; is not just a matter of mentality, but is realized only with the construction of such an advanced Zero Trust foundation.&lt;/p>
&lt;hr>
&lt;h1 id="onboarding-junior-engineers-and-the-transfer-of-tacit-knowledge">Onboarding Junior Engineers and the Transfer of Tacit Knowledge
&lt;/h1>&lt;p>Some point out that the biggest victims of full remote work are not senior engineers, but junior engineers who have just started their careers.&lt;/p>
&lt;p>Senior engineers already have a strong internal network, have accumulated domain knowledge, and possess the ability to execute tasks autonomously. For them, remote work can be the &amp;ldquo;ultimate environment for concentration.&amp;rdquo; However, junior engineers need to absorb undocumented &amp;ldquo;Tacit Knowledge,&amp;rdquo; not just &amp;ldquo;how to write code,&amp;rdquo; but also &amp;ldquo;who to ask questions,&amp;rdquo; &amp;ldquo;what the unwritten rules of the organization are,&amp;rdquo; and &amp;ldquo;the sense of urgency and troubleshooting intuition during incident response.&amp;rdquo;&lt;/p>
&lt;p>In an office environment, junior engineers absorb tacit knowledge like a sponge by glancing at a senior engineer&amp;rsquo;s screen from the side, listening to the sound of them typing, or catching snippets of hallway conversations with other teams. In a remote environment, this process of &amp;ldquo;learning by watching&amp;rdquo; is completely cut off. Unless time for pair programming or mob programming is intentionally scheduled, junior engineers risk being crushed by isolated debugging tasks, significantly flattening their growth curve.&lt;/p>
&lt;hr>
&lt;h1 id="in-search-of-the-optimal-solution-intentional-hybrid-or-full-remote">In Search of the Optimal Solution: Intentional Hybrid or Full Remote?
&lt;/h1>&lt;p>Based on the analysis so far, we can see that both &amp;ldquo;full office attendance&amp;rdquo; and &amp;ldquo;full remote&amp;rdquo; have decisive trade-offs.&lt;/p>
&lt;ol>
&lt;li>&lt;strong>Advantages of Full Remote&lt;/strong>: Promotion of deep work, elimination of commuting, access to a global talent pool, and secure, high-speed access via a Zero Trust foundation.&lt;/li>
&lt;li>&lt;strong>Advantages of Office Attendance&lt;/strong>: Occurrence of high-bandwidth communication based on the Allen Curve, synchronous discussions for complex architecture design, reduction of MTTR, and the onboarding of junior engineers and transfer of tacit knowledge.&lt;/li>
&lt;/ol>
&lt;p>The &amp;ldquo;hybrid model&amp;rdquo; adopted by many modern tech companies is not merely a product of compromise, but a rational strategy attempting to reap the benefits of both. However, to make the hybrid model successful, &amp;ldquo;intentional operation&amp;rdquo; is indispensable.&lt;/p>
&lt;p>For example, suppose a rule is set that &amp;ldquo;Tuesdays and Thursdays are office days (Anchor Days).&amp;rdquo; On these days, engineers should be prohibited from &amp;ldquo;putting on earphones and silently coding at their desks.&amp;rdquo; Office days should be defined as days completely dedicated to &amp;ldquo;synchronous collaboration,&amp;rdquo; such as design discussions using whiteboards, mob programming, lunches with other teams, and 1-on-1s. Then, the remaining remote work days should be protected as &amp;ldquo;no-meeting days,&amp;rdquo; purely for deep work facing the code.&lt;/p>
$$ T_{productivity} = f(C_{sync\_collab}, E_{deep\_work}, ZTNA_{performance}) $$&lt;p>An engineer&amp;rsquo;s comprehensive productivity is expressed as a complex function of the quality of synchronous collaboration, the quantity of deep work, and the comfortable access performance provided by a Zero Trust foundation. Intentionally designing, separating, and optimizing these is the true nature of a hybrid model.&lt;/p>
&lt;h1 id="conclusion-towards-a-compromise-between-engineers-and-management">Conclusion: Towards a Compromise Between Engineers and Management
&lt;/h1>&lt;p>The &amp;ldquo;Remote Work vs. Return to Office&amp;rdquo; debate is often framed as a conflict between &amp;ldquo;workers&amp;rsquo; rights vs. management&amp;rsquo;s desire to control,&amp;rdquo; but the essence does not lie there.&lt;/p>
&lt;p>Management must discard the illusion that &amp;ldquo;merely gathering people in an office will magically spawn innovation.&amp;rdquo; Forcing attendance without investing in modern infrastructure like Zero Trust or designing an organization to align with Conway&amp;rsquo;s Law in distributed system development will only lower engineer engagement and productivity.&lt;/p>
&lt;p>On the other hand, engineers (especially senior levels) must also amend the self-righteous perspective that &amp;ldquo;an office is unnecessary because I am more productive writing code alone.&amp;rdquo; Engineering is a team sport, and engineers bear broad responsibilities beyond just coding productivity, including overall system design, mentoring junior members, and coordinating during emergencies. It is a fact that high-bandwidth communication in physical spaces can sometimes save an entire project.&lt;/p>
&lt;p>The optimal solution varies depending on the phase of the company, team, and product. However, what is certain is that only organizations that understand the sociological nature of communication, measure their current state with multifaceted metrics like the SPACE framework, and continually break through constraints with technologies like Zero Trust architecture will gain true competitive advantage in this new era of work.&lt;/p></description></item><item><title>The Deepening of the 'New Digital Divide' Brought by the Evolution of Generative AI</title><link>http://kenji.blog/en/p/generative-ai-digital-divide/</link><pubDate>Sat, 12 Sep 2026 12:00:00 +0900</pubDate><guid>http://kenji.blog/en/p/generative-ai-digital-divide/</guid><description>&lt;img src="http://kenji.blog/p/generative-ai-digital-divide/img/eyecatch.jpg" alt="Featured image of post The Deepening of the 'New Digital Divide' Brought by the Evolution of Generative AI" />&lt;h2 id="1-introduction-historical-transition-of-the-digital-divide-and-the-new-paradigm">1. Introduction: Historical Transition of the Digital Divide and the New Paradigm
&lt;/h2>&lt;p>Since the popularization of the internet, we have often heard the term &amp;ldquo;digital divide&amp;rdquo; (information gap). The early digital divide was primarily about &amp;ldquo;physical access rights.&amp;rdquo; In other words, it was a simple scenario where whether or not one had a computer or high-speed internet connection determined access to information and economic opportunities. Later, as smartphones and broadband connections became commoditized, the focus of the divide shifted to &amp;ldquo;IT literacy&amp;rdquo; (information utilization capability). This involved the software and cognitive aspects, such as whether one could appropriately search for information using search engines or master software.&lt;/p>
&lt;p>However, the sudden emergence of Generative AI and the evolution of Large Language Models (LLMs) in the 2020s are fundamentally overturning this concept of the digital divide. What we are facing now is not merely a &amp;ldquo;divide in access to information&amp;rdquo; or a &amp;ldquo;divide in software operation skills.&amp;rdquo; It is a &amp;ldquo;divide in the ability to orchestrate (direct and integrate) AI,&amp;rdquo; a profound and irreversible &amp;ldquo;3rd Digital Divide&amp;rdquo; that determines whether an individual&amp;rsquo;s productivity is amplified exponentially or if they are left behind by the evolution of AI and lose relative value.&lt;/p>
&lt;p>In this article, we will unravel in great detail the true nature of this new digital divide brought about by Generative AI from three layers: the mathematical model of productivity, hardware architecture and cost, and the cognitive aspects of human beings.&lt;/p>
&lt;h2 id="2-from-access-to-orchestration-the-arrival-of-the-3rd-digital-divide">2. From &amp;ldquo;Access&amp;rdquo; to &amp;ldquo;Orchestration&amp;rdquo;: The Arrival of the 3rd Digital Divide
&lt;/h2>&lt;p>Past software tools were essentially &amp;ldquo;passive instruments.&amp;rdquo; The limitation of traditional software was that it returned deterministic results in response to the user&amp;rsquo;s explicit input (e.g., entering a formula in spreadsheet software to get a calculated result). However, current Generative AI, especially LLMs based on the Transformer architecture (GPT-4, Claude 3.5, Llama 3, etc.), act as &amp;ldquo;fragments of active intelligence.&amp;rdquo;&lt;/p>
&lt;p>Due to this paradigm shift, the required skill set for humans has dramatically changed from the &amp;ldquo;ability to operate tools&amp;rdquo; to the &amp;ldquo;ability to combine multiple AI agents and tools, and to design and direct autonomous workflows (AI Orchestration).&amp;rdquo; This can be called &amp;ldquo;AI Orchestration Literacy.&amp;rdquo;&lt;/p>
&lt;p>Below is the transition of the digital divide from the past to the present.&lt;/p>
&lt;pre class="mermaid">
flowchart TD
A[&amp;#34;1st Divide: Access to Hardware and Infrastructure (1990s-2000s)&amp;#34;] --&amp;gt; B[&amp;#34;2nd Divide: IT Literacy and Information Retrieval Skills (2010s)&amp;#34;]
B --&amp;gt; C[&amp;#34;3rd Divide: Prompting and Orchestration of Generative AI (2020s-)&amp;#34;]
C --&amp;gt; D[&amp;#34;Designing Autonomous Task Execution by AI&amp;#34;]
C --&amp;gt; E[&amp;#34;Integration of Multiple AI Agents (Agentic Workflows)&amp;#34;]
C --&amp;gt; F[&amp;#34;Advanced Information Verification and Hallucination Detection&amp;#34;]
&lt;/pre>
&lt;p>Moving beyond the boundaries of prompt engineering, we have now entered a stage where systems are made to autonomously solve problems using multi-agent frameworks like LangChain, AutoGen, and CrewAI. Between the &amp;ldquo;class that draws the blueprints and lets AI execute them&amp;rdquo; and the &amp;ldquo;class that still performs routine work manually,&amp;rdquo; a divergence in productivity is occurring at a speed that humanity has never experienced before.&lt;/p>
&lt;h2 id="3-the-matthew-effect-of-productivity-visualizing-the-divide-through-a-mathematical-approach">3. The Matthew Effect of Productivity: Visualizing the Divide through a Mathematical Approach
&lt;/h2>&lt;p>The &amp;ldquo;Matthew Effect,&amp;rdquo; derived from the New Testament saying &amp;ldquo;For to everyone who has, more will be given, and he will have abundance; but from him who does not have, even what he has will be taken away,&amp;rdquo; refers in sociology and economics to a phenomenon where early advantages lead to cumulative benefits. With the introduction of Generative AI, this Matthew Effect is strongly manifesting in the labor market and knowledge production.&lt;/p>
&lt;p>The productivity of an individual who effectively uses AI grows exponentially, not linearly, with time. This is because the time saved by AI can be further invested in building more advanced AI systems, optimizing prompts, and self-learning. Let us express this with a mathematical model.&lt;/p>
&lt;p>The productivity of a non-AI user $P_{human}(t)$ and the productivity of an AI orchestrator $P_{AI}(t)$ at a given time $t$ can be represented by the following models, respectively.&lt;/p>
$$
P_{human}(t) = P_0 (1 + r_{human})^t
$$&lt;p>
Here, $P_0$ is the initial productivity, and $r_{human}$ is the natural human learning rate (growth rate based on the experience curve). Generally, $r_{human}$ is very small, and growth tends to be arithmetic.&lt;/p>
&lt;p>On the other hand, the productivity of a user who fully utilizes AI combines the capability improvement rate of the AI model being used, $r_{model}$, and the compound interest effect of workflow automation by AI, $\alpha$.&lt;/p>
$$
P_{AI}(t) = P_0 \cdot \exp\left( \int_0^t (r_{human} + \alpha \cdot r_{model}(\tau)) d\tau \right)
$$&lt;p>Because the AI model itself is evolving exponentially (an increase in parameter count and computational complexity based on scaling laws), $r_{model}(t)$ itself increases over time. As a result, the difference in productivity between the two, $\Delta P(t)$, rapidly widens.&lt;/p>
$$
\Delta P(t) = P_{AI}(t) - P_{human}(t)
$$&lt;p>The graph below visually shows this divergence.&lt;/p>
&lt;pre class="mermaid">
xychart-beta
title Productivity Divergence Over Time (The Matthew Effect)
x-axis [&amp;#34;Year 1&amp;#34;, &amp;#34;Year 2&amp;#34;, &amp;#34;Year 3&amp;#34;, &amp;#34;Year 4&amp;#34;, &amp;#34;Year 5&amp;#34;, &amp;#34;Year 6&amp;#34;]
y-axis &amp;#34;Output Volume&amp;#34; 0 --&amp;gt; 200
line [10, 15, 30, 60, 110, 180]
line [10, 12, 14, 16, 18, 20]
&lt;/pre>
&lt;p>&lt;em>(Note: The blue line represents the productivity of the AI orchestrator, and the lower line represents the productivity of the non-AI user)&lt;/em>&lt;/p>
&lt;p>In the first year, the difference seems negligible, but each time the AI model evolves from GPT-3 to GPT-4, and further to its next generation, AI users enjoy a dramatic leap in productivity simply by plugging the new model into their existing automation pipelines. It becomes mathematically closer to impossible over time for non-AI users to close this gap.&lt;/p>
&lt;h2 id="4-the-hardware-divide-the-wall-of-local-inference-and-the-trap-of-cloud-apis">4. The Hardware Divide: The Wall of Local Inference and the Trap of Cloud APIs
&lt;/h2>&lt;p>The 3rd Digital Divide creates a new hardware gap not just in software skills, but in &amp;ldquo;access to compute (computational resources)&amp;rdquo; needed to run cutting-edge AI models.&lt;/p>
&lt;p>To utilize Large Language Models, there are mainly two approaches: &amp;ldquo;using Cloud APIs&amp;rdquo; or &amp;ldquo;running the model locally for inference.&amp;rdquo; Both have their pros and cons, which are forming a new economic and physical wall.&lt;/p>
&lt;h3 id="limitations-and-running-costs-of-cloud-apis">Limitations and Running Costs of Cloud APIs
&lt;/h3>&lt;p>State-of-the-art frontier models provided by OpenAI, Anthropic, and Google (GPT-4o, Claude 3.5 Sonnet, etc.) are generally accessed via API. However, if you build a highly autonomous agent (Agentic Workflow) that generates tens of thousands of API calls per day, the costs explode.&lt;/p>
&lt;p>The total cost of the API, $C_{cloud}$, depends on the volume of input and output tokens.&lt;/p>
$$
C_{cloud} = \sum_{i=1}^{N} \left( c_{in} \cdot T_{in}^{(i)} + c_{out} \cdot T_{out}^{(i)} \right)
$$&lt;p>
(Where $N$ is the number of requests, $T$ is the number of tokens, and $c$ is the unit price per token)&lt;/p>
&lt;p>When continuously performing large-scale data processing or vectorization for RAG (Retrieval-Augmented Generation), this variable cost can become a fatal burden for individual developers and small to medium-sized enterprises.&lt;/p>
&lt;h3 id="the-wall-of-local-llms-and-vram">The Wall of Local LLMs and VRAM
&lt;/h3>&lt;p>From the perspective of avoiding cloud costs and maintaining data privacy, the demand for running open-weight models like Meta&amp;rsquo;s Llama 3 and Mistral locally is increasing. However, the physical divide known as the &amp;ldquo;Wall of VRAM (Video RAM)&amp;rdquo; stands in the way here.&lt;/p>
&lt;p>The inference speed of an LLM depends more strongly on Memory Bandwidth rather than the calculation performance (FLOPS) of the GPU (it has a Memory-bound nature). Assuming the number of parameters of the model is $P$ and the precision is 16-bit (2 bytes), just loading the model into memory requires at least $2P$ bytes of VRAM. For example, a 70 billion (70B) parameter model demands over 140GB of VRAM.&lt;/p>
$$
VRAM_{required} \approx \left( \frac{P \times bits\_per\_weight}{8} \right) + Context\_Memory
$$&lt;p>Even with high-end GPUs available to general consumers (like the NVIDIA RTX 4090), VRAM is limited to 24GB, making it impossible to run a 70B class model as is. Here, &amp;ldquo;Quantization&amp;rdquo; technologies like AWQ and GGUF have emerged, and a technical struggle is taking place to find a compromise by compressing weights to 4-bit or 8-bit, but performance degradation (worsening of Perplexity) due to quantization is inevitable.&lt;/p>
&lt;p>Furthermore, in recent years, &amp;ldquo;AI PCs&amp;rdquo; equipped with NPUs (Neural Processing Units) have appeared, but the TOPS (Tera Operations Per Second) of current NPUs can only handle lightweight, small-scale models (SLMs: Small Language Models) at best. To truly perform highly advanced inference locally, you need the capital to build a multi-GPU environment costing millions of yen. This is the true nature of the &amp;ldquo;capital-intensive digital divide&amp;rdquo; in AI.&lt;/p>
&lt;h2 id="5-the-cognitive-divide-the-loop-of-hallucination-and-verification">5. The Cognitive Divide: The Loop of Hallucination and Verification
&lt;/h2>&lt;p>What is more terrifying than the disparity in hardware and skills is the &amp;ldquo;Cognitive Divide.&amp;rdquo; AI generates highly fluent and persuasive text, but at the same time, it causes &amp;ldquo;hallucinations,&amp;rdquo; outputting completely baseless information as if it were plausible.&lt;/p>
&lt;p>The divide that arises here is the separation between &amp;ldquo;the class that critically examines and verifies (fact-checks) AI output&amp;rdquo; and &amp;ldquo;the class that blindly believes AI output as an authoritative truth.&amp;rdquo; The former utilizes AI as a powerful brainstorming and drafting tool, performing quality assurance (QA) on the final output using their own domain knowledge. The latter sends incorrect information out into the world as is, which not only ruins their own credibility but also contributes to polluting the internet&amp;rsquo;s information space with spam-like content.&lt;/p>
&lt;p>The process of the Cognitive Verification Loop to prevent this is shown below.&lt;/p>
&lt;pre class="mermaid">
flowchart TD
A[&amp;#34;Human Intent&amp;#34;] --&amp;gt; B[&amp;#34;Prompt Input to AI (Prompting)&amp;#34;]
B --&amp;gt; C[&amp;#34;Generation by AI Model (Generation)&amp;#34;]
C --&amp;gt; D{&amp;#34;Cognitive Verification&amp;#34;}
D -- Doubts / Logical Failures Exist --&amp;gt; E[&amp;#34;Fact-checking using RAG or external tools&amp;#34;]
E --&amp;gt; F[&amp;#34;Readjusting / Refining Prompts&amp;#34;]
F --&amp;gt; B
D -- Facts and Logic are Valid --&amp;gt; G[&amp;#34;Final adjustments based on human domain knowledge&amp;#34;]
G --&amp;gt; H[&amp;#34;Output of Final Deliverable&amp;#34;]
&lt;/pre>
&lt;p>To iterate through this loop, one needs not only to understand how to use AI but also to possess deep &amp;ldquo;domain knowledge&amp;rdquo; and &amp;ldquo;critical thinking&amp;rdquo; concerning the output domain. Ironically, the more AI evolves, the more the requirements for humans shift away from basic operational skills to highly advanced cognitive abilities, such as philosophical and logical reasoning and the cultural sophistication to distinguish truth from falsehood.&lt;/p>
&lt;h2 id="6-the-new-class-society-ai-orchestrators-and-manual-workers">6. The New Class Society: AI Orchestrators and Manual Workers
&lt;/h2>&lt;p>In a future where these disparities have reached their limits (or a reality currently unfolding), the labor market will polarize in unprecedented ways.&lt;/p>
&lt;p>&lt;strong>1. AI Orchestrators (Top 1-5%)&lt;/strong>
In their fields of expertise, they construct workflows that autonomously run multiple AI agents. They delegate the majority of processes, such as research, coding, data analysis, and report generation, to AI, specializing themselves in &amp;ldquo;process design,&amp;rdquo; &amp;ldquo;exception handling,&amp;rdquo; and &amp;ldquo;final decision-making.&amp;rdquo; Their productivity reaches tens to hundreds of times that of traditional workers, creating immense economic value.&lt;/p>
&lt;p>&lt;strong>2. Traditional Knowledge Workers / Manual Workers&lt;/strong>
These are people who write code with their own hands, operate Excel with their own hands, and write text with their own hands. Their jobs will gradually be replaced by AI, or they will be relegated to &amp;ldquo;end-point monitoring and maintenance&amp;rdquo; of systems created by AI orchestrators, or forced into &amp;ldquo;labor in physical space.&amp;rdquo; Intellectual labor that does not utilize AI faces the risk of entirely losing its market competitiveness.&lt;/p>
&lt;h2 id="7-strategies-and-social-prescriptions-for-surviving-the-stratified-society">7. Strategies and Social Prescriptions for Surviving the Stratified Society
&lt;/h2>&lt;p>Amidst this overwhelming divide, how should individuals, corporations, and society adapt?&lt;/p>
&lt;h3 id="individual-strategies-adapting-to-the-paradigm-shift">Individual Strategies: Adapting to the Paradigm Shift
&lt;/h3>&lt;p>The most important thing is to discard the underestimation that &amp;ldquo;AI is just a chatbot.&amp;rdquo; It is necessary to develop the habit of treating AI as an &amp;ldquo;advanced intern&amp;rdquo; or a &amp;ldquo;team of experts&amp;rdquo; and constantly thinking about how you can break down your own work processes and delegate them to AI (Task Decomposition). Also, even if you cannot program, learning about the concept of APIs and data structuring (like JSON) enables powerful automation by combining No-Code/Low-Code tools (Zapier, Make, etc.) with AI.&lt;/p>
&lt;h3 id="corporate-strategies-ai-native-organizational-design">Corporate Strategies: AI-Native Organizational Design
&lt;/h3>&lt;p>For companies, simply &amp;ldquo;distributing ChatGPT accounts&amp;rdquo; is not enough. It requires infrastructure investment, such as redesigning the entire workflow around AI (BPR: Business Process Re-engineering), building a secure RAG environment, and fine-tuning local models with internal proprietary knowledge. Furthermore, introducing new KPIs to evaluate employees&amp;rsquo; AI orchestration capabilities is also required.&lt;/p>
&lt;h3 id="social-prescriptions-ai-infrastructure-as-a-public-good">Social Prescriptions: AI Infrastructure as a Public Good
&lt;/h3>&lt;p>At the national and societal levels, safety nets and education are needed so that the 3rd Digital Divide does not lead to severe economic disparities and social unrest. For instance, public support for the R&amp;amp;D of open-source AI models and making &amp;ldquo;Critical AI Literacy&amp;rdquo; compulsory in educational institutions can be considered. In addition, updating appropriate legal regulations and antitrust laws to prevent the &amp;ldquo;monopolization of AI models and computing resources&amp;rdquo; by Big Tech companies should be brought to the table for discussion.&lt;/p>
&lt;h2 id="8-conclusion-ride-the-wave-of-evolution-or-be-swallowed-by-it">8. Conclusion: Ride the Wave of Evolution, or Be Swallowed by It
&lt;/h2>&lt;p>The &amp;ldquo;new digital divide&amp;rdquo; caused by Generative AI is restructuring our society more rapidly and broadly than any technological innovation in the past. This divide appears as a difference in hardware computational resources, the ability to invest in Cloud APIs, and above all, the &amp;ldquo;cognitive and logical skills to orchestrate AI.&amp;rdquo;&lt;/p>
&lt;p>As the Matthew Effect of productivity indicates, this gap will expand unbridgeably over time. What we must do now is neither to fear the evolution of AI nor to blindly believe in it. It is to deeply understand the characteristics of AI, the greatest Intelligence Amplifier in human history, and decisively execute an &amp;ldquo;intellectual self-transformation&amp;rdquo; to update our own thinking and workflows.&lt;/p>
&lt;p>Will we stand on this side of the new digital divide, or remain on the other side? That choice is entrusted to our daily learning and actions, right at this very moment.&lt;/p>
&lt;hr>
&lt;p>&lt;em>If you have any opinions on this article or specific case studies on introducing AI orchestration, please send them to the comment section or the author&amp;rsquo;s social media.&lt;/em>&lt;/p></description></item></channel></rss>