Friday, February 3, 2012

Why it is not NPR vs UID

First. During the past week, we have had a lot of questions and a lot more messages of support at the thinkuid.org web site. My big Thank You to all those interested enough to participate, support or argue with us. It shows that you care.

[edit 4-Feb: Making some corrections, thanks to suraiya95's point that NPR is not a statistical exercise. So I will cross out the deletions & put additions in purple. I will distinguish between Census (the statistical exercise) and NPR (the new project by the Census dept). 
Net effect of these corrections: Either because I am pig-headed or perhaps my reasoning stands yet, the essence of my post remains. I leave it for you, the reader, to decide.]

Now for the tough part. Tough because NPR the Census is an otherwise good example of a huge project, well-executed. It is also tough because of my own first-hand experiences that color my views despite well-meaning admonition by a Director-Census once: "Don't let your personal experiences be the sole basis to pre-judge our work, Sastry".

I'll try to keep those in mind. This is going to be long, so grab that coffee, switch off that phone and make yourself comfortable. :)

NPR The Census is a great project, no doubt.
Those who criticize the NPR project Census Dept casually, can only do so when they don't understand the goals, the vast scope and the extraordinary amount of effort that goes into such a gigantic exercise. No doubt, it is a great project - created to count the population of India and various demographic profiles of the population, to better understand our nation as a whole. There in lies the problem.

It has been, and still is well-suited to be only a statistical exercise. The processes and the error-tolerances are perhaps within acceptable bounds, statistically speaking. But they are not good enough when it comes to matters that need every individual to be more than a statistic. Not acceptable when one or two, but a staggeringly large number of people are casually tossed aside as a mere statistical anomalies. Oh please don't quote percentages. Please be one-of-those anomalies and tell me.

Pardon me for being a skeptic. Perhaps I don't exist.
Since 1986 I've been trying to get on to the census and the electoral rolls. Without using bribes and calling favors of people I know, I have tried every possible avenue that I came across including online campaigns such as Jago Re. Stood in queues, wrote letters, stood against walls for photographs - all in vain. The only thing I did not do is to become a fanatic, chasing them day and night. Incidentally, the same government lets me be an income-tax payer (pan card), a vehicle-regn-fee-payer, a home-registration-fee-payer - but nothing where it doesn't want money from me. No ration card. No voter id card. Not on census. If this is my fate, what do you think is the plight of the poor ID-less?
I have no better result from the UID project either (waiting since June 2011; many attempts at follow-up and escalation silently rebuffed). So I won't defend UID on this count.
Now for the other points I've been hearing frequently.

#1. UID & NPR are double the effort, double the cost. Hard to argue, except when you consider that enumeration is very different from enrollment. In order to achieve coverage, even in enumeration you need multiple visits. Even more so, with enrollment.

I don't know about elsewhere, but in Haryana, we pay the operators only upon successful de-duplication -- effectively curtailing artificial enrollment inflation; and keeping costs within reason. Good enough, to curtail a majority of the costs, I think.

Overall, there is some credence to this argument; though it is not 100% duplication as it is criticized to be. Theoretically, this could've been avoided; but in practice I am not so sure. I see the current compromise as a vast improvement over the pre-compromise situation.

#2. UID & NPR cause double the pain to the citizens. Yes it is avoidable. Given that UID has set a scorching pace and high standards of quality of execution, would the NPR set aside its pride and UID do a job it is designed to do? If only prejudices are set aside one might see as a neutral party would. Instead of re-defining a statistical exercise as a deterministic one, NPR might embrace logic and piggy-ride on UID (permanent enrollment centers among other ideas).

This would strengthen the hands of "UID is not really optional" logic of some opponents, but it is still a workable method. It would actually recognize that the NPR's work would never really be 100% done -- it would correctly be designed as an ongoing exercise. So is UID work, of course.

Bottomline: Citizens are definitely inconvenienced by the government's pig-headedness; but to blame the UIDAI alone on this, is nothing but hypocrisy.

#3. NPR is more secure! Of all the tall claims, this is the most laughable. Here again, a personal example might help illustrate. I am sure a vast majority of passport holders will also agree with this.
Ironically for all the famed MHA's well-suitedness on security, it was a good samaritan Sri Lankan national in Bangalore who held me by hand, took me directly into the police commissioner's office, introduced me and got my police verification done in a few minutes. Every other transaction related to my passport (required police verification twice) since then was done by touts without my presence anywhere on the scene. The police officer once came home 3 months after the passport did - to ask for money for verification. 
Yes, I know, passport is MEA's area; but what about the police? How do the NPR proponents expect much better security from other apathetic government employees? These are the same employees who routinely ask that 30+ year-olds be enrolled as eligible for old-age pensions; and intimidate any private sector employee who dared ask questions during biometric enrolments of the said pensions. The same employees who, in panic, declared "dead" even those pensioners with bank accounts (that were opened with biometric enrollment, incidentally) - when they were asked to remove duplicates. Mild protests by NIC officers and yours truly were set aside under the "due process and empowerment" garb.

No, it doesn't inspire any confidence -- unless you are a statistician; in which case, you can find some solace in that most out-of-process (paid-for or otherwise) verifications are also genuine anyway. For all others, the question remains, "how many illegal immigrants got through this allegedly watertight security"? How many genuine citizens are left out not because of security, but because of apathy?

Someone told me about audit trails being a strong point of NPR. And UID isn't? Audit trails mean something when a) the original job hasn't been routinely botched up; b) when people have mechanisms to complain and they use it; and finally c) someone actually looks at those trails and does something about them. All the govt officers I have seen are content to write file notes and DO letters - instead of doing something, anything about security. Including in the UID project. So here is one more area where I can't be accused of bias.
[edit @4-Feb: There is some credence to the idea of community verification apparently being used in NPR. Admittedly, it is a strong method, esp., in rural India - when collecting biographic data. But it leaves the door open for exploitation of the ID-less by the very same power-centers who excommunicate people or order honor killings. This could still be made to work: e.g., biometrics enrollment "anywhere" guarantees identity; other processes for dispute resolution on biographic data.]
Bottomline: Security arguments are lame, IMHO. If you are still worried about fake UID enrollments, please read my blog post Consequences of a fake UID

#4. Two outstanding issues with NPR - that I cannot comment on with the same feeling and authority as the above.
  • How is citizenship determined (inclusions and exclusions) in the light of all this? I am yet to finish reading all the relevant documents; as yet I am unconvinced. (yes, as suraiya95 pointed out, the citizenship issue is no longer central to UID vs NPR debates - though not everyone has left it behind just yet)
  • What exactly is the meaning of "NPR is mandatory"? It is mandatory for all citizens to enroll? Or mandatory for Census Dept to enroll all citizens? What happens if either party defaults? No clear answers yet; searching for them.
A note of balance before closing:
  • In all the above, please note that I did not rate UID as higher than NPR in anything other than the scorching pace and high standards of execution. The idea is not to vilify one in favor of the other; rather to put things in perspective.
  • In all my years in working with the government, I have had a chance to work with some very diligent govt officers - including some exemplary police officers and a few passionate regular employees. Most of them suffer silently.
Done correctly, pro-NPR and pro-UID proponents (me included) should bury their hatchets (and egos) and get down to doing a good job. There are people out there with outlandish arguments to derail both sides. Squabbling on this topic will get us nowhere.

13 comments:

  1. Many issues raised here. Going one by one:-
    (1) NPR is NOT a statistical exercise. The first part of the NPR- creation of a mother database- was done along with the first phase of census work, houselisting, to save costs and time. This does not mean it is the same exercise. There is no intention of using NPR data for demographic purposes, since the Census Act has clear methodologies for that
    purpose and the real demography was captured in
    the second phase of census work, the population enumeration, over six months later. This difference is
    very germane because all Census data is
    confidential by law. However, the creation of a frame
    of households, geographically mapped, frozen at a
    particular time, achieved during houselisting is the
    most thorough possible way to ensure coverage, and
    this helps make the census a credible statistical
    exercise and helps go about creating the NPR in a
    verifiable way too.
    (2) The issue is not really if the census left you out or
    not- no one is perfect, certainly not anyone in Bharat
    sarkar- but whether there is an existing mechanism
    to verify whether you were really left out, and, at
    least for NPR purposes, to enrol you afterwards.
    Such a mechanism does exist.
    (3) The entire "UID-vs-NPR" fuss is really only about
    one issue- should there be a single, fully
    accountable, registrar or should there be multiple
    registrars? Let's put it this way- if you're a top gun at
    a large organization and you have to implement a
    biometric access solution in all your establishments
    for your employees, how would you do it? Ask each
    dept head to give you a location wise list and profile
    of all employees and then set up enrollment stations
    locally for them, keeping count to make sure every
    individual is covered, or put up a come- one, come
    -all booth next to the soda can dispenser in the
    cafe? And maybe ask two biometric vendors to set
    up two prettily decorated booths next to each other
    hoping they will fight it put and thus capture
    everyone?The answer is obvious. Why then should
    a country do it differently with it's residents? That
    too on taxpayers money?
    (4) The cost issue cannot be wished away by saying
    the vendor is paid only on enrollment. When the
    Uidai knew that the NPR already had tendered and
    awarded enrollment work, on what grounds did it
    insist on going ahead with the multi registrar story?
    By paying state governments Rs 50 per enrollment
    when it was well known that vendor cost is about half
    of that. The state govts were paid despite the fact
    that it was said that the state govts would benefit by
    cutting leakages etc. If I am to save money by using
    your product, would you pay me to use it or would I
    pay you? Besides, the NPR wasn't paid anything to
    enrol. For doing the same task, ie to deliver
    enrollments to the Uidai. Which it would have done within a year or two at half that cost, already budgeted for. Does that make any sense?.

    ReplyDelete
  2. (5) Regarding the "voluntary" nature of Uidai enrolment- it is illusory. In principle, if all genuine PDS cards are on aadhar, and all fake PDS cards are not on aadhar, but both are valid because aadhar is not compulsory, how on earth does it stop leakages? Leakage stopping schemes can only work if they are compulsory. And once any public scheme makes aadhar compulsory, enrollment becomes de facto compulsory. NPR doesn't indulge in any such hypocrisy. It is compulsory. RGI will make it as convenient as possible for a resident to enrol, but the onus to enrol is on the resident.
    (6) About " high-handed" MHA, refusing to take data of other registrars- it's a classic case of putting the cart before the horse. If anyone has been reading this far, it is the Uidai who has been refusing to take data from the NPR! Hence the multi registrars! After enrollments have been made, just "accepting" data means matching databases at the back end. Which is quite frankly impossible. That is why the Uidai itself despite using the idea to sell to state govts has no plans to match databases like PDS, voter rolls etc at the back end. The present way out of accepting aadhar numbers at NPR camps would have worked better if a biometric was also captured for authentication at the camp. Let's see how it works in practice.

    ReplyDelete
  3. (7) Of course I agree- who wouldn't? On the usually terrible attitude of govt employees for anything at all. So, how are the non NPR enrollments being done? The answer is, by public sector banks, state PDS deptts, or revenue deptts. Who have hired the pvt agencies empanelled by the Uidai. And who have no system to control anything happening in the camps. The Headlines Today/ Aaj Tak expose is representative of the method being followed. So since the Uidai has been demonising the NPR and extolling it's other registrars, does it mean that the RGI, who conducts the Census, one of the few truly world class accomplishments of the Indian Govt, is likely to conduct it's responsibilities MORE inefficiently, MORE corruptly, and MORE laughably than any state PDS deptt? Does such a claim hold water? The fact is that the NPR has an unbuilt verifiability, has full provision for becoming an ongoing exercise with local permanent centres, and is to be conducted under an existing law- the Citizenship Act. It can only do a BETTER job than other registrars. Not a WORSE job. To imply otherwise is unfair and illogical to put it mildly.
    (8) The issue of citizenship is not part of the NPR exercise except for the declaration of nationality in the NPR form. The NPR is the nationwide set of local registers of usual residents. It will only be possible to address the citizenship issues with all attendant legal complexities after the NPR is created.

    ReplyDelete
  4. Replies
    1. (9) It is true that the NPR has enrolled about 1 crore while non NPR registrars have romped ahead. This ignores however the fact that the entire database of the country has already been collected by the NPR. There were many ways in which the tie up with the Uidai caused undue delays in the NPR which need not be detailed here. However, it must be pointed out that RGI does it's work not only by its own staff but also through the state govts. And once the state govts had accepted the Rs 50 per enrollment offered for non NPR registrars, it became difficult for them to give NPR primacy! One wonders if the MHA should have offered Rs 51 per enrollment?
      (10) The private sector ethos of competition works only with private investment and private risk. No government anywhere works on such a principle- govt Deptts competing- on taxpayers money!. As you correctly concluded, government Deptts need to work together. I still feel it's not too late. The NPR process should be followed to make enrollments and the Uidai should de duplicate and develop service apps and systems. It can be done!

      Delete
  5. Lastly- a forum to think deeply about issues related to UID needs most of all to lobby hard for passing of privacy laws! The consequences of so much data out there, as yet unregulated, must be thought out carefully by all knowledgeable folks and brought out to the public and to the government.

    ReplyDelete
  6. @suraiya95: I was hoping to put this (UID vs NPR saga) behind and move on.. it doesn't seem so easy now. I am not an ardent fan of the UIDAI or its people; yet that I see more sense in what they do than what you claim.

    (1) Thanks for correcting the census vs NPR confusion. It is indeed the census that is the statistical exercise - while the NPR (quoting from Census FAQ): "... will be a comprehensive identity database ... It is being done for the first time in the country". The rest of the census website and facebook (e.g., "You count, so we count") correctly focus on the statistical exercise.

    I will correct this in the main blog post (leaving strikeouts to show the correction, if the s/w allows).

    What do I see from this? The intent, history and past achievements are all in statistical exercises. The desire is there to go beyond, and do something for the first time. Given the vast difference between a statistical exercise and an identity project, to claim the census history and smoothly transition to Census+NPR present is a huge stretch of credibility - at least to those such as me.

    (2) NPR has a mechanism to verify whether I was left out. UID doesn't? But I guess you were only defending census; not accusing UID...

    (3) The org-structure problem is not as black-and-white as you make it to be. I don't think Census Dept had a handle on the biometric stuff or the identity management story at all. It did have a good claim - and it was overlooked. Let those who made those decisions defend their actions. Not I.

    I am happy with the decision - mainly because I (and most others that I know) have waited long years for the existing government depts to get their act together. After 25yrs of ignominy, I am willing to give the UIDAI a chance.

    (4) As one tax payer, I am not sorry that my money is being spent on the UID project and not the NPR. Not just because of anti-incumbency, but because I see & hear (and hence believe) that the UIDAI knows ID-Management better than the Census Dept. As a citizen and as a Technologist.

    They may still goof up. Then it will be their turn to be overridden by the next project.

    I hope that with this, most other points become moot.

    On the Aaj Tak / Headlines today, like many others, you too seem to have missed the beauty of biometrics based ID-management. Please see my post Consequences of a fake UID

    ReplyDelete
  7. On your (10): Despite all your logic, you are sadly back to the "my way or highway" approach to "working together".
    a) The time for this was before the decision was made to give the job to the UIDAI. And then again before the current compromise was stuck. To continue harping on it is unproductive.
    b) I support the decision - because of reasons I've already outlined - namely:
    -- I've waited 25yrs;
    -- The UIDAI seem to know this particular area better than any;
    -- Census may be good in other things, not quite in this.

    Please note that this support of mine is neither a broad acceptance of everything that is going on in the UID & the UIDAI; but an expression of confidence based on what I see.

    On 11 ("Lastly-"): I will write on this separately (out of the NPR context). Meanwhile I urge the Census Dept to look at its own inconsistent pronouncements on this matter e.g., "data is confidential" (your post above) but "lists will be printed out and displayed at prominent places... (in the Census FAQ in "C-> NPR Process" Section); further down in "G" it also says "The information will not be shared with any agency Government or private"; Same para "... [the database] will be used only within the government".

    I am not an alarmist. I understand data security quite deeply; and the balance to strike between accessibility being a primary requirement of "utility value of data". Yet, for anyone supporting NPR to talk about privacy is like .... :)

    ReplyDelete
    Replies
    1. NPR is perfectly happy to leave data management to the Uidai. RGI has no desire to convert into an IT czar. The ONLY problem is in methodology of Biometric data collection. The point of how RGI is a WORSE agency as govt agencies go than the average state PDS deptt stays unanswered by your reply. Unless the average middle class-and-up person no longer needs the PDS deptt and hence doesn't care. The point of paying Rs 50 where Rs 25 was doing the job should matter to a taxpayer. If it doesn't, I'm glad the country is rich enough to afford it. And no, there is no question of my way or the highway! How does that come in? NPR has made each and every concession to ensure it's data is acceptable to Uidai. At any rate, I am not party to these decisions any more than you are, so my way doesn't count at all :). What the Headlines Today expose showed hasn't been understood by you perhaps if it didn't worry you. It showed effectively that someone can steal your papers, pass himself off as you in some other state, and get an aadhar in your name. When you go for your aadhar, either you get rejected on de duplication by name, or there will now be two persons with your identity. If the other guy reaches your bank/ PDS/ etc before you do, he gets your benefits. And if both of you get everything- then what has been gained by spending so much money if frauds cannot be stopped? Call me pig headed, sure, but I'm a logical pig. Please remember that if the RGI has never done such an exercise before, nor have any of the IAS officers in the Uidai. A little clearheaded thinking will help.

      Delete
    2. I will react only on one point. This, on the Headlines Today expose and your remarks in that context:
      1) They may steal your papers - but not your identity.
      ii) Even if someone registered in your name, you will get a UID (due to your biometrics); not rejected "on de duplication by name". This is perhaps a gross misunderstanding on your part.
      iii) In the UID database (and equally so in NPR too) there may be many people with the same name, but there will only be one "you".
      iv) So the "bank/PDS/etc" cannot give away your benefits to someone else for this reason.

      If what I said already didn't convince you, perhaps nothing will. So I will desist repetitive / circular arguments; and let the readers apply their own minds and conclude as they see fit.

      Delete
    3. Not at all misunderstood! Gross or otherwise. Your identity is the sum of you and whatever you have achieved or possess or are related to. Unless you are willing to give away everything you have achieved or possess as of date and start out as a new born baby by virtue of having a brand new aadhar number and a new minted identity. Please apply your mind again. Like you, I too have no axe to grind. If the best minds in the country can't get this simple point, the country is seriously in danger. I'm sorry I have clearly dragged on the issue longer than you're willing to take it. Please understand that I am doing it because it MATTERS. Debate shouldn't only be about convincing someone else of your point of view. Debate brings out issues neither side may have thought enough about. The idea is to make things better by talking about them, not to prosetylise. That's how I see it!

      Delete
  8. Lastly, just a bit childish, don't you think, to say that the decision is now made so let the NPR go stew? Please remember that the NPR has "lost" nothing in this "compromise".It still goes everywhere. It still covers everyone. It has to, that's what the law says! And just because a decision was made doesn't mean one shouldn't examine it or think about it any more. Like I've been saying often enough up there- this is the Government. It's not the private sector. This stuff matters to everyone, not only to CEOs and shareholders.

    ReplyDelete