Saturday, November 14, 2015

Colombo by tuk-tuk

[14th November] My 2016 diary
I had some adventures in 2012 from my journeys in New Delhi by tuk-tuk.. Usually tuk tuk drivers have been nice to me in Sri Lanka, and specially the ones with meter never asked for more than what is shown in their meters unlike in New Delhi. They often claim that they do not have change and try to keep the 10 - 20 rupees change to themselves. But usually that is it.

This time I experienced some differences as I was travelling with a foreigner. First, we were going from Bambalapitiya to Thurston. The driver diverted the three wheeler to Dimbrigasyaya - Jawattha. I asked him "Why are we going here, when Thurston is not this side?" He claimed that he was avoiding the traffic. He took a round trip and came back from Reid Avenue, Colombo Campus, and back to Thurston. It took me some time to realize that he intentionally took us on a long ride to charge more money. However, since this was my first negative experience, I decided to be more careful. The next time another three wheeler driver started the ride without actually resetting the meter, and hence charged for 1.9 km that we did not really travel. After that I always ensured that they reset their meters.

From my overall negative experiences this time, I realized, wherever the country, there are people who try to cheat the foreigners. Their logic is usually the foreigners have more money - and charging them more is  reasonable. I hope for a world where people treat everyone equally without such a double standard - foreigner or not. I have always been under the impression that Sri Lankans treat the foreign visitors better. It was a bit disappointment for me to observe the contradicting behaviours from my fellow citizens. 

After 2 years away from my country, I felt many differences in the country. Also feeling a bit more like a tourist in my own country. This was just a short trip of 25 days, and finally I returned to Lisbon to continue my regular daily life. This year was full of trips. I am now waiting for 2016 - full of events and travels, I suppose.

Thursday, November 5, 2015

A Guide to Commenting on the Blog Posts

Number of spam comments on my blog posts is on the rise these days. However, since the comments are moderated, these spam comments never see the light of the day. I just delete them. This waste my time as well as the time of the spammer, assuming no bot is deployed for commenting as sign-in is required for commenting. Automated commenting would trigger the Blogger captcha which is pretty effective in filtering bots, I assume.

Here is a guide on which is accepted and which is not, as a comment.

1. A long and relevant comment - Accepted.

2. A short comment such as "Nice post", "Thanks" - Accepted.

3. A set of random links - NOT Accepted. Isn't it obvious, after all?

4. A short comment followed by a link to your shitty home page - NOT Accepted. Obviously you just wanted to post the link to your shitty site. Just do not pretend.

5. A long shitty comment followed by a link to a shitty web site - NOT Accepted. Why? See #4 for the reason.

6. A long relevant comment followed by a link to your shitty home page - Accepted. After all you have shared some useful information.

7. A long comment followed by a link to your shitty home page - Depends on the blog administrator's decision based on the contribution of the comment vs. the shittiness of your web site.

8. A random useless comment - Depends.

9. A short/long comment that disagrees with the view point of the original post - Accepted. Comments are there for positive or negative feedback.

10. A random comment followed by a link to a random site - Not Accepted. If you want to advertise in the blog, just contact the blog administrator. Posting random links in the comment section will do no good for you.

11. A well-structured comment followed by a very relevant link - May be accepted. If the link is really relevant, it should be fine. However, if you are just attempting to advertise your own web site, it is better to communicate to the blog administrator than writing it down as a comment.

Thursday, October 29, 2015

∂u∂u Multi-Tenanted Framework: Distributed Near Duplicate Detection for Big Data

Our paper "∂u∂u Multi-Tenanted Framework: Distributed Near Duplicate Detection for Big Data" Pradeeban Kathiravelu, Helena Galhardas, Luís Veiga was presented at the 23rd International Conference on COOPERATIVE INFORMATION SYSTEMS (CoopIS 2015), 28-30 October 2015, Rhodes, Greece.

Due a clash in my travel schedules, I could not attend the conference and present the paper myself. Hence, my supervisor and co-author Prof. Luís Veiga presented the paper in Greece on the 29th of October.

Abstract.
Near duplicate detection algorithms have been proposed and implemented in order to detect and eliminate duplicate entries from massive datasets. Due to the differences in data representation (such as measurement units) across different data sources, potential duplicates may not be textually identical, even though they refer to the same real-world entity. As data warehouses typically contain data coming from several heterogeneous data sources, detecting near duplicates in a data warehouse requires a considerable memory and processing power.

Traditionally, near duplicate detection algorithms are sequential and operate on a single computer. While parallel and distributed frameworks have recently been exploited in scaling the existing algorithms to operate over larger datasets, they are often focused on distributing a few chosen algorithms using frameworks such as MapReduce. A common distribution strategy and framework to parallelize the execution of the existing similarity join algorithms is still lacking.

In-Memory Data Grids (IMDG) offer a distributed storage and execution, giving the illusion of a single large computer over multiple computing nodes in a cluster. This paper presents the research, design, and implementation of ∂u∂u, a distributed near duplicate detection framework, with preliminary evaluations measuring its performance and achieved speed up. ∂u∂u leverages the distributed shared memory and execution model provided by IMDG to execute existing near duplicate detection algorithms in a parallel and multi-tenanted environment. As a unified near duplicate detection framework for big data, ∂u∂u efficiently distributes the algorithms over utility computers in research labs and private clouds and grids.

The full paper can be accessed here.


Friday, October 16, 2015

Git Rebase for OpenDaylight/Gerrit

I hate merge conflicts, and luckily so far I did not have to do a git rebase for gerrit in OpenDaylight. However, this time I had to. So here are the steps I followed.

https://git.opendaylight.org/gerrit/#/c/28471/1

pradeeban@llovizna:~/OpenDaylight/distribution$ git-review -d  28471
Creating a git remote called "gerrit" that maps to:
    ssh://pradeeban@git.opendaylight.org:29418/integration/distribution.git
Downloading refs/changes/71/28471/1 from gerrit
Switched to branch "review/pradeeban_kathiravelu/28471"
pradeeban@llovizna:~/OpenDaylight/distribution$


pradeeban@llovizna:~/OpenDaylight/distribution$ git rebase origin/master
First, rewinding head to replay your work on top of it...
Applying: Add messaging4transport to integration
Using index info to reconstruct a base tree...
M    features/index/pom.xml
M    features/index/src/main/resources/features.xml
M    features/test/src/main/resources/features.xml
M    pom.xml
Falling back to patching base and 3-way merge...
Auto-merging pom.xml
CONFLICT (content): Merge conflict in pom.xml
Auto-merging features/test/src/main/resources/features.xml
CONFLICT (content): Merge conflict in features/test/src/main/resources/features.xml
Auto-merging features/index/src/main/resources/features.xml
CONFLICT (content): Merge conflict in features/index/src/main/resources/features.xml
Auto-merging features/index/pom.xml
CONFLICT (content): Merge conflict in features/index/pom.xml
Failed to merge in the changes.
Patch failed at 0001 Add messaging4transport to integration
The copy of the patch that failed is found in:
   /home/pradeeban/OpenDaylight/distribution/.git/rebase-apply/patch

When you have resolved this problem, run "git rebase --continue".
If you prefer to skip this patch, run "git rebase --skip" instead.
To check out the original branch and stop rebasing, run "git rebase --abort".




pradeeban@llovizna:~/OpenDaylight/distribution$ git status
rebase in progress; onto b524a56
You are currently rebasing branch 'review/pradeeban_kathiravelu/28471' on 'b524a56'.
  (fix conflicts and then run "git rebase --continue")
  (use "git rebase --skip" to skip this patch)
  (use "git rebase --abort" to check out the original branch)

Unmerged paths:
  (use "git reset HEAD ..." to unstage)
  (use "git add ..." to mark resolution)

    both modified:      features/index/pom.xml
    both modified:      features/index/src/main/resources/features.xml
    both modified:      features/test/src/main/resources/features.xml
    both modified:      pom.xml

no changes added to commit (use "git add" and/or "git commit -a")



Modify the offending files, the files that are marked as 'both modified'.

Add the modified files.
pradeeban@llovizna:~/OpenDaylight/distribution$ git add features/index/pom.xml features/index/src/main/resources/features.xml features/test/src/main/resources/features.xml pom.xml

pradeeban@llovizna:~/OpenDaylight/distribution$ git rebase --continue
Applying: Add messaging4transport to integration


pradeeban@llovizna:~/OpenDaylight/distribution$ git status
On branch review/pradeeban_kathiravelu/28471
nothing to commit, working directory clean

To amend or modify the commit message,
pradeeban@llovizna:~/OpenDaylight/distribution$ git commit --amend -s

Finally submitting the changes to gerrit,
pradeeban@llovizna:~/OpenDaylight/distribution$ git review
Your change was committed before the commit hook was installed.
Amending the commit to add a gerrit change id.
remote: Processing changes: updated: 1, refs: 1, done   
remote:
remote: Updated Changes:
remote:   https://git.opendaylight.org/gerrit/28471 Adding messaging4transport features.
remote:
To ssh://pradeeban@git.opendaylight.org:29418/integration/distribution.git
 * [new branch]      HEAD -> refs/publish/master/28471

Saturday, October 3, 2015

2015 and the Flowers of Autumn

Flowers once more.
Each year is different, specially in Europe. This year, it started to get colder in August. But summer returned in September. It is getting a bit colder, yet sunny in Lisbon in October. The small plants in my apartment are having colourful flowers, just like in summer, once again in 2015.

This summer was pleasant. Spring was equally comfortable. Autumn has just started. So I will refrain from complimenting it yet. I kinda miss the early days of 2015. :) It went smooth and I had a good time.

The trip to Frankfurt was the first this summer. It is just a small city. Till early September, I was travelling a lot this year. Even after that, I still have 3 papers accepted to 3 different conferences - that means, in 3 different countries. Due to the clash in my time schedule, visa delay, or other reasons, I could not attend. Hence, I missed the opportunity to travel Sydney - Australia, Rhodes - Greece, and Vancouver - Canada this year. However, that does not demotivate me, as I am enjoying the sunny Lisbon, working on my EMJD-DC projects. :)
Frankfurt river view.


Also I just completed my first year of PhD, and entered the second year a few days ago. Have a long way to go. This year felt long, but at the same time, it also felt that the time passed pretty quick. It is contradictory, I know. Winter is not so cool in Lisbon. Specially when it just rains - wet and cold. There is no proper central heating system either. No snow and so there is no fun associated with snow, unless I decide to travel to some other countries. More or less, I have been living in Portugal for 3 years. However, with the mandatory mobility and internships, I am foreseeing my next migration next year. I am starting to feel the fear how can I pack all my things for the migration. :P Probably I will have to throw a considerable amount of things before moving. I also contribute to the Humana Portugal regularly. That is really a great initiative, reducing wastage specially when we leave the country.