9/27/2014

Maintaining stable ids between GRCh37 and GRCh38

http://www.ensembl.info/blog/2014/07/08/maintaining-stable-ids-between-grch37-and-grch38/

As mentioned in another post, due to the presence of patches in both GRCh37 and GRCh38, the assembly mapping has proven challenging.
Related to this, another novelty arises when assigning stable ids to genes.
Every time a gene set is updated for a species, we compare the newest gene set with the previous one.
If we find a perfect match between the two gene sets, the stable id assigned to the older model will be used for the new model.
Even if the model has changed slightly (longer UTR for example), we try to map the old stable id whenever possible, with a version change to indicate that it was not a perfect match.
To provide a better comparison between the last GRCh37 gene set (e!75) and the new GRCh38 gene set (e!76), we have decided to project the old set onto the new assembly. This allows for overlap comparisons rather than simple sequence alignments. However, this means that around 2% of the genes are lost, as they can not be mapped onto the new assembly. If these gene models are still present in the new assembly, they are being assigned a new stable id.
Putting this in perspective of patch fixes integrated into the new reference, we also have cases where two genes in GRCh37 (one of the reference, one on the patch) both match the same gene on the new reference in GRCh38.
In that case, we have decided to arbitrarily keep the longest standing stable ID, which is likely to be the one on the reference.
The stable ID which was used on the patch is recorded as retired but a link is provided to its replacement. For example, searching for ENSG00000260384 (SERINC2 gene on HG989_PATCH) will redirect the user to ENSG00000168528 (SERINC2 on the primary assembly).
Screen Shot 2014-06-27 at 10.46.23Screen Shot 2014-06-27 at 10.48.13
This resulted in the deletion of around 3% of our genes.
In other cases, the difference between the GRCh37 reference (without patch) and the GRCh38 reference (with integrated patch fix from GRCh37) is too important to project annotations from the reference. Only annotations from the patch are then kept, along with the stable ids. For these cases, if there is a known alt_allele to a gene on the GRCh37 reference, it is added as a link to its equivalent on the patch.
Consequently, searching for ENSG00000183678 (CTAG1A gene on the GRCh37 primary assembly) will redirect the user to ENSG00000268651 (CTAG1A gene on HG1497_PATCH in GRCh37, on the primary assembly in GRCh38).
As mentioned in the blog post about the new gene set, a new assembly implies a number of underlying changes in the gene structure.
Despite this, 95% of all the gene stable ids have been assigned to the new gene models.
With this work, we try and ensure that you will still be able to find your favourite gene using the same stable id as in GRCh37.

9/24/2014

different ls output to terminal and pipe

Try these commands:

ls -1 | wc -l
ls | wc -l
ls | cat

We can use the first two commands to count the number of files. It is easy to understand the first one works. But the second command does not seem to work as expected at the first glance. However, you will find it really works the same way as the first one. The reason can be seen from the last command -- ls outputs the results to pipe in the same way as "ls -1" to terminal.

http://unix.stackexchange.com/questions/157285/why-does-ls-wc-l-show-the-correct-number-of-files-in-current-directory

http://git.savannah.gnu.org/cgit/coreutils.git/tree/src/ls.c

Jewish Holidays 2014-2015

http://www.hebcal.com/holidays/2014-2015

Major holidays

Dates in bold are yom tov, so they have similar obligations and restrictions to Shabbat in the sense that normal "work" is forbidden.
HolidayDatesDescription
Rosh Hashana -, 2014 The Jewish New Year
Yom Kippur Day of Atonement
Sukkot -, 2014
-, 2014
Feast of Tabernacles
Shmini Atzeret Eighth Day of Assembly
Simchat Torah Day of Celebrating the Torah
Chanukah -, 2014 The Jewish festival of rededication, also known as the Festival of Lights
Purim Purim is one of the most joyous and fun holidays on the Jewish calendar
Pesach -, 2015
-, 2015
-, 2015
Passover, the Feast of Unleavened Bread
Shavuot -, 2015 Festival of Weeks, commemorates the giving of the Torah at Mount Sinai
Tish'a B'Av The Ninth of Av, fast commemorating the destruction of the two Temples

 

Minor holidays

HolidayDatesDescription
Tu BiShvat New Year for Trees
Purim Katan
Minor Purim celebration during Adar I on leap years
Shushan Purim Purim celebrated in Jerusalem and walled cities
Days of the Omer
7 weeks from the second night of Pesach to the day before Shavuot
Pesach Sheni Second Passover, one month after Passover
Lag B'Omer 33rd day of counting the Omer
Leil Selichot Sep 5, 2015 Prayers for forgivenes in preparation for the High Holidays

Minor fasts

HolidayDatesDescription
Tzom Gedaliah Sep 28, 2014 Fast of the Seventh Month, commemorates the assassination of the Jewish governor of Judah
Asara B'Tevet Jan 1, 2015 Fast commemorating the siege of Jerusalem
Ta'anit Esther Mar 4, 2015 Fast of Esther
Ta'anit Bechorot Apr 3, 2015 Fast of the First Born
Tzom Tammuz Jul 5, 2015 Fast commemorating breaching of the walls of Jerusalem by Nebuchadnezzar

Modern holidays

HolidayDatesDescription
Yom HaShoah Holocaust Memorial Day
Yom HaZikaron Israeli Memorial Day
Yom HaAtzma'ut Israeli Independence Day
Yom Yerushalayim Jerusalem Day

Special Shabbatot

HolidayDatesDescription
Shabbat Shuva Shabbat that falls between Rosh Hashanah and Yom Kippur (Shabbat of Returning)
Shabbat Shekalim Shabbat before Rosh Chodesh Adar
Shabbat Zachor Shabbat before Purim
Shabbat Parah Shabbat of the Red Heifer
Shabbat HaChodesh Shabbat before Rosh Chodesh Nissan
Shabbat HaGadol Shabbat before Pesach
Shabbat Chazon Shabbat before Tish'a B'Av (Shabbat of Prophecy/Shabbat of Vision)
Shabbat Nachamu Shabbat after Tish'a B'Av (Shabbat of Consolation)
Shabbat Rosh Chodesh
When Shabbat falls on Rosh Chodesh
Shabbat Machar Chodesh
When Shabbat falls the day before Rosh Chodesh

Rosh Chodesh

HolidayDatesDescription
Rosh Chodesh Cheshvan Beginning of new Hebrew month of Cheshvan
Rosh Chodesh Kislev Beginning of new Hebrew month of Kislev
Rosh Chodesh Tevet Beginning of new Hebrew month of Tevet
Rosh Chodesh Sh'vat Beginning of new Hebrew month of Sh'vat
Rosh Chodesh Adar Beginning of new Hebrew month of Adar
Rosh Chodesh Adar II
Beginning of new Hebrew month of Adar II (on leap years)
Rosh Chodesh Nisan Beginning of new Hebrew month of Nisan
Rosh Chodesh Iyyar Beginning of new Hebrew month of Iyyar
Rosh Chodesh Sivan Beginning of new Hebrew month of Sivan
Rosh Chodesh Tamuz Beginning of new Hebrew month of Tamuz
Rosh Chodesh Av Beginning of new Hebrew month of Av
Rosh Chodesh Elul Beginning of new Hebrew month of Elul
 

9/22/2014

Apache webserver & vsftpd


10/9/2014

Some updates about the apache settings. I have made it work now. Generally it is simple to use apache, but it bites at certain points. ---- it is not the problem of apache; instead, it is from the network environment.

As previously I modified the httpd.conf file and decided to use the default folders. When I test the syntax with "apachectl -t", it returned "Syntax OK". But I couldn't see the page from my Mac. When tried to visit the website from the server itself, it worked! That meant the service was Ok.

Then, I tested the website from Mac on the same LAN. But I failed. That meant the sever refused connection from other computers. I also get some error message from the firefox browser in which it's mentioned that the computer may be protected by firewall. Therefore I checked the /etc/sysconfig/iptables. I found port 80 was not open by default. Then I opened the port 80. Everything worked fine.

I collected some useful webpages, listed below for reference. These links are more helpful to me than previously collected ones.

Apache配置详解(最好的APACHE配置教程)
originally from: http://aiks.blog.com.cn/archives/2006/1748482.shtml  (invalid now)
a backup from: http://liudaoru.iteye.com/blog/336338

Apache详细配置
http://bbs.chinaunix.net/thread-1941372-1-1.html

linux下配置管理Apache服务器
http://jingyan.baidu.com/article/375c8e1977b50e25f2a229a6.html

今天各种坑 库连不上,apache装起来外面访问不了,fsockopen 权限不够
http://blog.csdn.net/pennyliang/article/details/7342042


9/22/2014

笨死了,今天是搞不定这个阿帕奇了。有空再折腾吧。。。。

收藏几个链接备用:

 http://www.faqs.org/docs/securing/chap29sec245.html


How To Setup Apache Virtual Host Configuration (With Examples)
http://www.thegeekstuff.com/2011/07/apache-virtual-host/

http://serverfault.com/questions/293866/apache-says-documentroot-doesnt-exist-when-it-does

http://httpd.apache.org/docs/2.2/

http://httpd.apache.org/docs/2.2/vhosts/name-based.html
http://httpd.apache.org/docs/2.2/invoking.html


也可以尝试一下使用ftp服务器:


Setup FTP Server step by step in CentOS / RHEL / Scientific Linux 6.3/6.4/6.5
http://ostechnix.wordpress.com/2013/12/15/setup-ftp-server-step-by-step-in-centos-6-x-rhel-6-x-scientific-linux-6-x/



 https://access.redhat.com/solutions/187873

Environment

  • Red Hat Enterprise Linux 6.3
  • Red Hat Subscription Manager (RHSM)

Resolution

  • Run the following commands to refresh certificates on the system with the problem and then try to run yum check-update
# subscription-manager refresh 
# yum check-update
  • If the issue persists then try following :
  • Run the command as mentioned below which removes all of the subscriptions and identity data from the local system, without affecting the consumer information in the subscription service.
# subscription-manager clean 
  • Now unregister your system with command:
# subscription-manager unregister
  • Go to Customer Portal search with hostname of the system in the System tab and note down the UUID
  • Register your system with following command(using the UUID noted from customer portal):
# subscription-manager register --consumerid=<system UUID>
You can also refer # man subscritption-manager for more information.

Root Cause

  • The system's local entitlement information was corrupted or lost somehow.

How locust brain senses polarization patterns in the sky

Receptive Fields of Locust Brain Neurons Are Matched to Polarization Patterns of the Sky

Highlights

Locust brain neurons integrate polarization signals from all parts of the sky
Neural responses to polarized light reflect the E vector pattern in the sky
Neurons in the brain act as matched filters to the sky polarization pattern
Locusts can determine the solar azimuth by relying on polarization vision alone

 DOI: 10.1016/j.cub.2014.07.045


Full-size image (43 K)

9/16/2014

One Bite Rule

Hope never to be bitten by a dog.

http://dogbitelaw.com/one-bite-rule/overview-of-the-one-bite-rule.html



pic from http://dogbitelaw.com/images/dog_bite_victims/pit-charging.gif

time zone converter

Sometimes I want to attend webinar  online, but the time is given as in a different time zone. So a time zone converter is needed to get the local time. Here are two convenient tools to do this job.

http://www.timeanddate.com/worldclock/converter.html

http://www.worldtimebuddy.com/

9/15/2014

Does Linux really eat much mem as displayed?

When we check the mem usage by the "top" command, probably we will see a low free mem as shown in the figure below. But is that the real case that only a small amount mem is left for applications?








That info is a bit cheating. We may have a large amount of mem ready for other programs. The major problem is that Linux defines used and free mem in a different way from our intuition. 



We can use "free" to see how much mem is available for new applications. The number in the "free" column and in the line of "-/+ buffers/cache" is the real mem available. Much larger than it appears, right?




To learn more about the Linux mem, please refer to the following links.

Linux ate my ram!
http://www.linuxatemyram.com/
 
http://www.linuxatemyram.com/play.html

http://www.binarytides.com/linux-command-check-memory-usage/