Kartic's Musings on Corporate Information and Knowledge Management

August 4, 2015

Building Information Architecture Bridges

Filed under: SharePoint — kartickapur @ 3:10 am

Having being involved in numerous enterprise content management (ECM) and eDRMS implementations over last decade, if there is one thing I have noticed as being single most important bridge between technology and achieving successful business outcome, it would be a well-defined Information Architecture (IA).

To start with, I found this great definition from uasbility.gov website in an article titled ‘information architecture basics’:

Information architecture (IA) focuses on organizing, structuring, and labelling content in an effective and sustainable way.  The goal is to help users find information and complete tasks.  To do this, you need to understand how the pieces fit together to create the larger picture, how items relate to each other within the system [from ‘Information Architecture Basics’, http://www.usability.gov/what-and-why/information-architecture.html]

Any implementation of technology for managing information (whether it is on SharePoint 2013 on premises, Office 365 or any other vendor platforms) cannot and must not start before thorough consideration and planning of Information Architecture principles. Most industries have well defined industry standards for managing information lifecycle (creating, storing, accessing, presenting and disposing content). Australian government national archives for example provide information on some generic standards used in Australia and internationally http://www.naa.gov.au/records-management/strategic-information/standards/international-standards/index.aspx. Before starting on your IA journey get yourself familiarised with your Industry standards or partner yourself with someone who is familiar with them.

In order to create a successful IA it is helpful to consider the following venn diagram which encapsulates ‘information ecology’ theory proposed by Rosenfeld and Moreville. It talks about interdependent nature of users, content and context:

From <http://www.usability.gov/what-and-why/information-architecture.html>

Understanding basic considerations

Based on the three parameters of user, content and context, let me break down some further considerations:


  • Software boundaries
    • Database limits
    • Limits for site collections (in sharepoint for example)
    • List view threshold limits (in sharepoint)
  • Records Managements Requirement
    • Compliance related records for legal purposes
    • Retention and Disposal Policies
      Records management is a whole different topic that can take few articles to describe. If interested, this link from ‘National Archive of Australia’ provides a comprehensive guide and overview of classification tools for records management: http://www.naa.gov.au/Images/classifcation%20tools_tcm16-49550.pdf
  • Business Process Almost all content is tied to a process. Map the process and you will know how to manage the content.
    • Is there are requirement to apply automated workflow to certain types of content
    • Base IA on activities rather than organisational structure
      • Think about possibilities around future organisational structure
      • Having said that, there will always be some information which will rely on org structure like team administration, management
    • Consider business classification scheme relevant to the industry (Resource sector will be completely different from finance for instance)
  • Culture – any technology implementation that doesn’t align with corporate culture will most like fail.


  • Search
    • Search refiners
    • Build central search
    • Build local search centre
      (Microsoft defines some technical parameters around planning content search in SharePoint here)
  • Metadata
    • Again from search perspective
    • Views
    • Business classification
    • Data flow (consider workflow)
  • Considerations around type of content or file types
    • Media content is a classic example
    • Document
    • Lists
    • Forms
    • Web content


  • Mobility
    • A mobile sales driven team would have different requirements to staff with desk jobs
  • Usability
    Remember not to overwhelm users with too many options. Last thing you want is users restoring to saving critical business information on their pen drive because they are overwhelmed with choices to store content. What I mean is don’t get carried away while defining:
  • Number of containers or repositories
  • Number of content types to choose from
  • Number of metadata columns which users have to fill in (technologies like SharePoint allow certain columns to be defaulted).

 Get started

Here are few things to consider in every phase of implementing a successful system based on strong IA principles:


  • Get your hands on industry standards if possible.
  • Get an understanding of compliance related requirements
  • Workshop to solicit requirements from cross section of your organisation (finance, procurement, HR etc). This will not only help you understand high level requirements but will also give business a sense of ownership right throughout the process.
  • Scalability requirements would be handy if known – historical view of information sprawl in most cases will be useful to plan for future growth

 Planning (defining and information architecture framework)

  • Plan for infrastructure (based on scalability, disaster recovery, mobility etc.) while considering IA requirements and not in isolation. Infrastructure planning does not form part of IA exercise but from my experience a disconnect between the two can be disastrous.
  • Map information containers around logical information categories. Examples could be:
    • Team
    • Project
    • Records
    • External partners
    • Industry specific information with examples being:
      • Seismic information (for resources sector)
      • Insurance claims (for insurance)
  • Plan metadata
    • Define business classification scheme (BCS) based on industry standards (this is especially relevant for implementing records management). Again, refer to this link for comprehensive overview of records management related classification tools: http://www.naa.gov.au/Images/classifcation%20tools_tcm16-49550.pdf
    • Define common vocabulary (or metadata) with examples being locations, business functions (based on BCS),   asset tags etc.
    • Think about retention and disposal schedules based on compliance requirements.
    • Define Global content types (relevant for SharePoint) – remember to keep this list small (typically less than 50 global content types for a large organisation and less than 20 for a small to medium size). If you want to know more about content types, go to office support article for detailed overview here.
  • Plan how users will navigate for information
    • Increasingly organisations are resorting to mobile app based navigation as a primary navigation mechanism
    • Traditionally speaking, navigation should not reflect organisational structure
  • Plan how users will search for information (Microsoft defines some technical parameters around planning content search in SharePoint here). As a general practice plan for some high level principles around:
    • Content sources to search for (here is Microsoft technet article on result sources)
    • What would be available in global search vs local search. As an example, some specific repositories like claims in insurance need to have local search centre (and search page) rather than results appearing in global search.
    • Search refiners that users may look for to narrow down on search results (It helps to take queue from car or house sale websites to visualise what I am talking about here). (here is a Microsoft technet article to help you understand technical background behind defining search schemas)
    • Plan how search will be ranked (here is Microsoft technet article on search order results in SharePoint 2013)


All I will say is for a successful implementation, follow some of these guidelines (this is from my experience):

  • Roll out iteratively rather than one big bang approach
  • Measure success and information management maturity over time
  • Slight modifications in approach can be necessary if results are not evident over time
  • Treat the project as a change management exercise rather than technology implementation

Change Management and Training

  • This should not start once project is closed, it’s a continuous process
  • Develop a framework for selecting your power users who will champion the change from within the business
  • Train the power users and get them to train the end users
  • Develop training videos or single page training modules to reduce training budget
  • Measuring information management maturity over time can be time consuming but a simple survey can be useful tool to develop ongoing strategies


  • Develop the following 4 tiered approach to avoid having to rely on staffing up big support team:
    • Tier 1: End users themselves:
      • Continuously train end users so that they are self-reliant
      • Create a self-help FAQ portal for end users with links to training manuals/videos etc
    • Tier 2: Power Users within the business: these champions should act as first point of contact if there is a requirement or an issue.
    • Tier 3: service centre: IT service centre needs to be trained in calls that does not require extensive time commitment to resolve
    • Tier 4: Functional BA/System specialists


Although I have left it for the end, in the absence of ongoing governance structure none of the above will be sustainable beyond six months of rollout. Governance, in a nutshell is process which will ensure that whatever framework and policies have been defined are adhered to on a regular basis. Governance can be implemented with the combination of:

  • Ensuring content ownership within the business
  • Creating executive governance group which meets regularly (at least once a month) to discuss changes and issues
  • Process which will ensure right level of ownership and approval for actions
  • Strongly defined responsibility, accountability, consulted and Informed (RACI) model
  • Technology can ensure adherence of governance to certain extent
  • Communication of governance principles and educating users on benefits on regular basis

Use Social to tie it all together

Technologies like yammer provide a glue to help ever evolving user entered context around information. Conversations centred around information can drive user adoption and discoverability while pushing up innovation in your organisation. Check out this yammer use case catalogue.


If you have made it this far, congratulations! At the end, although I have blabbered on for quite some time, this may sound like an oxymoron but please don’t complicate things unnecessarily. Spend lot of time on planning but please put yourself in user’s shoe and keep it simple for that end user.


July 10, 2015

De-mystifying Big Data

Filed under: SharePoint — kartickapur @ 2:24 pm

I have heard the term ‘big data’ mentioned at least 5 million times in last couple of years and to be really honest, at times, I have struggled to define this concept perfectly. This article is an attempt to de-mystify it a bit for those who are lost in the sea of data about big data!

So here goes:

What is big data about? Well it is quite simple really. Its about these 3 things:

  • Its about Large volumes of data – when I say large volumes, it means things that traditional data processing solutions can’t handle)
  • Its about diversity of data – data gathered from social media, sensors, other devices, web applications, consumer behaviour etc.
  • Its about data streaming – data delivered at different speeds and frequencies.

Why, then you would ask, should we embrace big data for your company? Instead of me trying to come up with a sales pitch, let me reference some information from Bain and Company study. Better still, let me share a cool diagram:

big data 1

(here is the reference: From Bain & Company report (2014), ‘Big Data” The organizational challenge’, Microsoft Enterprise website http://www.microsoft.com/enterprise/it-trends/big-data/articles/big-data-the-organizational-challenge.aspx)

Then is it really different from BI? Yes and No. Here is my attempt at explaining why:

  • ‘Big Data analytics’ is a BI practice
  • Big data analytics explores granular details of business operations and customer interactions that seldom find their way into a data warehouse or standard report.
  • Types of implementations
    • Companies that manage big data in their Enterprise Data Warehouse (EDW) and execute most analytical processing there.
    • Companies that design their EDW for the well understood, auditable and ‘clean data’ that average business report demands and distribute their effort onto secondary analytic platforms.
    • Hybrid approach

Just to put things into perspective, if you are still not convinced about big data, let me share a case study (done by Microsoft with you). Here are my notes on that study:

From study conducted for manufacturing sector in US, here are some key facts –

  • $371 Billion potential net value of data dividend over 4 years if companies become data smart.
  • Recommendation to perform 4 actions to realize a 60% greater return on their data assets:
    • bring together even as few as 3-4 discrete data sources,
    • use modern analytics tools to glean insights from data,
    • surface those insights in a consumable fashion to the right decision makers across the company and
    • ensure that insights from data are shared in a timely manner.
  • Key Benefits (for manufacturing)
    • Employee Productivity – running highly automated manufacturing plants where robots, devises, sensors, software are connected increases productivity
    • Operational Improvement – Improving operational efficiencies and lowering costs using predictive analytics (condition based maintenance, better energy management, improved asset management)
    • Product Innovation – using data to drive business growth with smarter product planning and innovation
    • Customer Facing – Building better customer engagement models and uncovering new service offerings

And here is a pie chart to display these statistics (because I love pie charts):

big data 2

(here is the reference: From <http://blogs.technet.com/b/vertical_industries/archive/2014/05/22/the-371-billion-opportunity-for-data-smart-manufacturers.aspx>)

July 1, 2015

Office 365 Tenancy – sharing with other companies

Filed under: SharePoint — kartickapur @ 8:58 am

As companies embark on their cloud journey, I am sure more organisations will be asking themselves whether there is more. The answer is ‘Yes’ there is always more as we embark on next technological advancement that we can’t even comprehend. But my thoughts drift towards whether we can get more from the existing technology. Well this is where I started thinking about whether, while sharing Infrastructure in the cloud, would companies not gain from sharing tenancy (in office 365 for instance). We did some analysis on this and came up with some exciting outcomes.

Think about possibilities of Inter-organisation collaboration beyond what good old extranet can offer and lately made possible with technologies like Yammer.

Some examples where shared tenancy can work as not just an enabler for saving cost but also driving collaboration and innovation are:

  • Hospitals – Can lead to shared customer database, increased knowledge sharing in real time for doctors and in stretch scenarios being able to leverage off resources by sharing them when needed.
  • Government Departments – The possibilities are endless as we start connecting department of education to human resources, Customs with immigration, renewable energy with ‘well’ Energy, finance with every other government department.
  • Schools – I can’t even begin to enlist the possibilities here
  • The list can go on…and on

But wait! before you embark on this journey, here are few things to consider:

  • Governance
    • How will this be managed? Perhaps a governance board would be a good start with membership representing different companies.
  • Security
    • You can lock down information of course, but this is again a Governance decision.
    • This shared tenancy cannot become a repository for records management (unless there is a good reason for that)
  • Information Architecture
    • Where does information live?
    • How do users navigate to information
    • Search – right people being able to search for relevant information
    • Business Taxonomy – there has to be an agreement on this if you go for a central taxonomy architecture. Go for distributed model if consensus is not possible.
  • What about customizations?
    • This is a governance question as well but falls under IT governance. Perhaps another committee with members from IT departments of these organisations.
    • A big plus is the possibility of introducing cross departmental automation of business processes. This will need to be ratified with central governance committee – both business and IT groups.
  • User Identity management
  • Administration – who controls it. This is all about power.

I am not sure how many private organisations are seriously considering this but I have started to see some shared tenancies popping up in government set up.

March 2, 2010

Xcelsius helps build some really visually appealing dashboards in SharePoint

Filed under: SharePoint — kartickapur @ 12:46 am

I have been using Xcelsius for some time now to build some visually appealling dashboards to be published on Corporate Intranet.

Xcelsius is a powerful product from SAP (http://www.sap.com/solutions/sapbusinessobjects/sme/reporting-dashboarding/index.epx) which can help you build dashboards for the following scenarios:

1. If you have a web service built to fetch data from any data source, you can build connections in Xcelsius to use the data and dump it into an excel spreadsheet. Other data sources like xml and direct link to database can also be configured.

2. Excel interface in Xcelsius helps you perform complicated calculations.

3. Build in visual components in xcelsius like dashboards, maps, tables, graphs etc can be configured to visually display the data or use calculcated values from any columns, rows or cells in excel to display rich dashboards.

4. You can export these dashboards in flash .swf format and store them in a document library. These can be shown on any page with a simple content editor web part and this simple code: <EMBED height=773 type=application/x-shockwave-flash width=1024 src=http://sharepointsite/Document library URL/Dashboard.swf> </EMBED>

5. Remember not to build too many queries (web service or otherwise) on the first load. This will result in a page which takes ages to load and your web service engine to be heavily utilised.

6. SharePoint connector can help you display data using web part connections.

7. You can even create dashboard which does queries based on user input.

The possibilities are endless – and can be unlocked by your imagination. Go and download Xcelsius. Even if you are not using Business Objects as BI platform in your company, the client (desktop) version of this product s not expensive. Try it now!

Some of the examples of the dashboards produced by me are shown below (I have removed some of the sensitive data but you will get the picture):

February 24, 2010

SharePoint 2010 Hands on Day

Filed under: SharePoint — kartickapur @ 5:12 am

I Power - Hands On Day

« Newer PostsOlder Posts »

Create a free website or blog at WordPress.com.