어제 미국 NRC에서 미국내 대학원 과정을 랭킹한 결과가 발표되었다. 그런데 전산학과 랭킹 계산에 있어서 큰 오류가 지적되어 전산과 랭킹은 내년 가을에 수정해서 공지하게 되었다. 가장 큰 문제가 저널 논문만 연구 실적에 계산했다는 점이다. 수정된 방법론에서 제일 큰 변화는 Thomson-Reuters Web of Science의 자료를 사용하지 않고 "based on CVs submitted by faculty members"을 쓰기로 한 것이다. 이게 무슨 말이냐 하면 저널 자체가 전산학 분야에는 좋은 논문이 발표되는 곳이 아니기 때문에 저널 피인용횟수에 근거하지 않고, 대신 미국 대학 교수들의 이력서에 있는 학술대회들을 고려하겠다는 뜻이다. 이렇게 정리된 학술대회가 265개. 어느 나라에서나 새로운 분야, 특히 기존 학문과 많이 다른 경우 평가가 쉽지 않음을 또 다시 느꼈다.
http://www.cra.org/ Computing Research Association은 미국내 200여개 전산학과를 대변하는 단체로 이번 조사의 문제점을 지적하고 NRC와 같이 새로운 평가 기준을 만드는 노력을 하고 있다. 지금 홈피에 가보면 "CRA Statement on NRC Ranking of Graduate Program"으로 이번 NRC 랭킹에 대한 입장이 정리되어 있다.
http://www.cra.org/resources/crn-online-view/reinvigorating_the_field/
Reinvigorating the Field
Musings from the chair by Eric Grimson, CRA Board Chair
http://www.cra.org/resources/conferencelist/
3DIM International Conference on 3D Digital Imaging and Modeling
AAAI AAAI Conference on Artificial Intelligence
AAMAS International Conference on Autonomous Agents and Multi-agent Systems
ACL Association for Computational Linguistics
ACSAC Asia-Pacific Computer Systems Architecture Conference
AICCSA ACS/IEEE International Conference on Computer Systems and Applications
AINA International Conference on Advanced Information Networking and Applications
AIPS Conference on AI Planning and Schedulig
AISTATS International Conference on Artificial Intelligence and Statistics
ANCS ACM/IEEE Symposium on Architectures for Networking and Communications Systems
APSCC Asia-Pacific Services Computing Conference
ARITH IEEE Symposium on Computer Arithmetic
ASAP International Conference on Apps for Specific Array Processors
ASE Automated Software Engineering Conference
ASIACRYPT International Conference on the Theory and Application of Cryptology and Information Security
ASPLOS Architectural Support for Programming Languages and Operating Systems
ATS Asian Test Symposium
AVSS Advanced Video and Signal Based Surveillance
BIBE IEEE Bioinformatics and Bioengineering
BPM International Conference in Business Process Management
CASES International Conference on Compilers, Architecture, and Synthesis for Embedded Systems
CAV Computer Aided Verification
CC International Conference on Compiler Construction
CCC IEEE Symposium on Computational Complexity
CCCG Canadian Conference on Computational Geometry
CCGRID IEEE International Symposium on Cluster, Cloud, and Grid Computing
CCS ACM conference on Computer and communications security
CGO International Symposium on Code Generation and Optimization
CHI International Conference on Human Factors in Computing Systems
CIKM ACM international conference on Information and knowledge management
CIVR International Conference on image and video retrieval
CLUSTER IEEE International Conference on Cluster Computing
CODES+ISSS International conference on Hardware/software codesign and system synthesis
COGSCI Annual Meeting of the Cognitive Science Society
COLING International Conference on Computational Linguistics
COLT Annual conference on Computational learning theory
COMM Conference on Applications, technologies, architectures, and protocols for computer communication
COMPSAC International Computer Software and Applications Conference
CONEXT ACM International Conference on Emerging Networking Experiments and Technologies
CP International Conference on Principles and Practice of Constraint Programming
CRYPTO Advances in Cryptology
CSB IEEE Computational Systems Bioinformatics Conference
CSCW Conference on Computer supported cooperative work
CSEET Conference on Software Engineering Education and Training
CSF IEEE Computer Security Foundation Symposium
CVPR IEEE Conference on Computer Vision and Pattern Recognition
DAC Digital Arts and Culture
DATE Design Automation and Test in Europe Conference
DCOSS IEEE International Conference on Distributed Computing in Sensor Systems
DDECS IEEE International Symposium on Design and Diagnostics of Electronic Circuits and Systems
DIGITEL IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning
DISC International Symposium on Distributed Computing
DS-RT IEEE International Symposium on Distributed Simulation and Real Time Applications
DSN Workshop on Assurance Cases for Security
EC ACM conference on Electronic commerce
ECAI Europeon Conference on Artificial Intelligence
ECCB European Conference on Computational Biology
ECCV European Conference on Computer Vision
ECOOP European Conference on Object Oriented Programming
EDBT Extending Database Technology
EDCC European Dependable Computing Conference
EG Eurographics
EMNLP Empirical Methods in Natural Language Processing
EMSOFT ACM Conference on Embedded Software
EPEP Conference on Electrical Performance of Electronic Packaging
ER International Conference on Conceptual Modelling
ESA European Symposium on Algorithms
ESEC European Software Engineering Conference
ESOP European Symposium on Programming
ESORICS European Symposium on Research in Computer Security
EUROCRYPT International Conference on the Theory and Applications of Cryptographic Techniques
Eurosys Eurosys Conference
FAST Conference on File and Storage Technologies
FCCM IEEE Symposium on Field-Programmable Custom Computing Machines
FMCAD Formal Methods in Computer-Aided Design
FOCS IEEE Symposium on Foundations of Computer Science
FSE International Workshop on Fast Software Encryption
GECCO Genetic and Evolutionary Computation
GRID IEEE/ACM International Conference on Grid Computing
HC Hot Chips
HiPC Int'l. Conf. High Performance Computing
HiPEAC International Conference on High Performance and Embedded Architectures and Compilers
HOTI IEEE Symposium on High Performance Interconnects
HotOS USENIX Workshop on Hot Topics in Operating Systems
HPCA International Symposium on High Performance Computer Architecture
HPCC IEEE International Conference on High Performance Computing & Communications Conference
HPDC ACM International Symposium on High Performance Distributed Computing
Hypertext ACM conference on Hypertext and hypermedia
i3D ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
IAAI Innovative Applications in AI
IACR International Association for Cryptologic Research
ICAC IEEE International Conference on Autonomic Computing
ICALP International Colloquium on Automata, Languages and Programming
ICAPS International Conference on Automated Planning and Scheduling
ICASSP International Conference on Acoustics, Speech and Signal Processing
ICC IEEE International Conference on Communications
ICCAD IEEE/ACM International Conference on Computer-Aided Design
ICCCN International Conference on Computer Communications and Networks
ICCI IEEE International Conference on Cognitive Informatics
ICCP IEEE International Conference on Intelligent Computer Communication and Processing
ICCS International Conference on Computational Science
ICCV IEEE International Conference on Computer Vision
ICDCS International Conference on Distributed Computing Systems
ICDE International Conference on Data Engineering
ICDM IEEE International Conference on Data Mining
ICDT International Conference on Database Theory
ICEBE IEEE International Conference on e-Business Engineering
ICFP Intl Conf on Functional Programming
ICGSE IEEE International Conference on Global Software Engineering
ICICIC International Conference on Innovative Computing, Information and Control
ICIS International Conference on Information Systems
ICLP International Conference on Logic Programming
ICMAS International Conference on Multi-Agent Systems
ICML International Conference on Machine Learning
ICNP International Conference on Network Protocols
ICPP Int'l. Conf. Parallel Processing
ICPR International Conference on Pattern Recognition
ICRA International Conference on Robotics and Automation
ICS ACM International Conference on Supercomputing
ICSE International Conference on Software Engineering
ICSLP International Conference on Spoken Language Processing
ICSM IEEE International Conference on Software Maintenance
ICST International Conference on Software Testing Verification and Validation
ICWS IEEE International Conference on Web Services
ICWSM International Conference on Weblogs and Social Media
IFIP-TM IFIP International Conference on Trust Management
IISWC International Symposium on Workload Characterization
IJCAI International Joint Conference on Artificial Intelligence
IJCAR International Joint Conference on Automated Reasoning
IMC Internet Measurement Conference
INFOCOM IEEE Conference on Computer Communications
INFOVIS IEEE Information Visualization Conference
INTERACT IFIP Conference on Human-Computer Interaction
INTERSPEECH Annual Conference of the International Speech Communication Association
IOLTS IEEE International On-Line Testing Symposium
IPCCC IEEE International Performance Computing and Communications Conference
IPDPS IEEE International Parallel and Distributed Processing Symposium
IPMI Information Processing in Medical Imaging
IPSN Information Processing in Sensor Networks
IROS International Conference on Intelligent Robots and Systems
ISC Information Security Conference
ISCA ACM International Symposium on Computer Architecture
ISLPED International Symposium on Low-Power Electronics and Design
ISMAR IEEE/ACM International Symposium on Mixed and Augmented Reality
ISMB Intelligent Systems for Molecular Biology
ISMM International Symposium on Memory Management
ISMVL International Symposium on Multiple-Valued Logic
ISORC IEEE International Symposium on Object-Oriented Real-time Distributed Computing
ISPA IEEE International Symposium on Parallel and Distributed Processing with Applications
ISPASS IEEE International Symposium on Performance Analysis of Systems and Software
ISSAC Intl. Symposium on Symbolic and Algebraic Computation
ISSCC Int'l Solid State Circuits Conf
ISSRE International Symposium on Software Reliability Engineering
ISSTA International Symposium on Software Testing and Analysis
ISVLSI IEEE Computer Society Annual Symposium on VLSI
ISWC Intl Semantic Web Conference
ITC IEEE International Test Conference
ITNG International Conference on Information Technology: New Generations
IUI International Conference on Intelligent User Interfaces
JCDL/DL International conference on Digital libraries
KDD Conference on Knowledge Discovery and Data Mining
KR International Conference on Principles of Knowledge Representation and Reasoning
LCN IEEE Conference on Local Computer Networks
LCTES ACM SIGPLAN Conference on Languages, Compilers and Tools for Embedded Systems
LICS IEEE Symposium on Logic in Computer Science
MASCOTS Symposium Model Analysis and Simulation of Computer and Telecommunications Systems
MASS IEEE Internatonal Conference on Mobile Adhoc and Sensor Systems
MDM IEEE International Conference on Mobile Data Management
MICCAI Medical Image Computing and Computer Assisted Interventions
MICRO International Symposium on Microarchitecture
MIDDLEWARE ACM/IFIP/USENIX International Middleware Conference
MM ACM Multimedia Conference
MMCN ACM/SPIE Multimedia Computing and Networking
MobiCom ACM International Conference on Mobile Computing and Networking
MobiHoc ACM Symposium of Mobile and Ad Hoc Computing
Mobisec International ICST Conference on Security and Privacy in Mobile Information and Communication Systems
MobiSys ACM SIGMOBILE International Conference on Mobile Systems, Applications and Services
NAACL/HLT Human Language Technologies: Conference of the North American Chapter of the Association for Computational Linguistics
NANOARCH IEEE/ACM International Symposium on Nanoscale Architectures
NAS International Conference on Networking, Architecture and Storage
NDSS Usenix Network and Distributed System Security Symposium
NIPS Advances in Neural Information Processing Systems
NOMS Network Operations and Management Symposium
NSDI Symposium on Networked Systems Design and Implementation
OOPSLA ACM Conference on Object-Oriented Programming, Systems, Languages, and Applications
OSDI USENIX Symposium on Operating Systems Design and Implementation
PACT International Conference on Parallel Architectures and Compilation Techniques
PADS ACM/IEEE/SCS Workshop on Parallel and Distributed Simulation
PERCOM IEEE International Conference on Pervasive Computing and Communications
PERFORMANCE International Symposium on Computer Performance, Modeling, Measurements and Evaluation
PLDI ACM SIGPLAN Conference on Programming Language Design and Implementation
PODC ACM Symposium on Principles of Distributed Computing
PODS ACM SIGMOD-SIGACT-SIGART Conference on Principles of Database Systems
POLICY IEEE International Symposium on Policies for Distributed Systems and Networks
POPL ACM-SIGACT Symposium on Principles of Programming Languages
PP SIAM Conference on Parallel Processing for Scientific Computing
PPoPP Principles and Practice of Parallel Programming
PSB Pacific Symposium on Biocomputing
PVLDB Proceedings of the Very Large Databases Endowment
RAID International Symposium on Recent Advances in Intrusion Detection
RE IEEE International Requirements Engineering Conference
RECOMB International conference on Computational molecular biology
RSS Robotics: Science and Systems Conference
RTAS IEEE Real-Time and Embedded Technology and Applications Symposium
RTSS IEEE Real-Time Systems Symposium
S&P IEEE Symposium on Security & Privacy
SAC ACM symposium on Applied Computing
SACMAT Symposium on Access Control Models and Technologies, ACM (was RBAC)
SAINT International Symposium on Applications and the Internet
SBAC-PAD International Symposium on Computer Architecture and High Performance Compuing
SC ACM/IEEE Supercomputing Conference
SCG ACM Symposium on Computational Geometry
SDM SIAM International Conference on Data Mining
SEA International Symposium on Experimental Algorithms
SEC IFIP International Information Security Conference
Securecomm International ICST Conference on Security and Privacy in Communication Networks
SenSys ACM Conference on Embedded Networked Sensor Systems
SGP Eurographics symposium on Geometry Processing
SIGCOMM ACM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication
SIGGRAPH ACM SIG International Conference on Computer Graphics and Interactive Techniques
SIGIR ACM International Conference on Research and Development in Information Retrieval
SIGMETRICS ACM SIG on Computer and Communications Metrics and Performance
SIGMOD ACM Special Interest Group on Management of Data Conference
SIGSOFT International symposium on Foundations of software engineering
SoCG Symposium on Computational Geometry
SODA ACM/SIAM Symposium on Discrete Algorithms
SOSE IEEE International Conference on Sytem of Systems Engineering
SOSP ACM SIGOPS Symposium on Operating Systems Principles
SPAA Symposium on Parallelism in Algorithms and Architectures
SPLASH Systems, Programming, Languages, and Applications: Software for Humanity
SRDS Symposium on Reliable Distributed Systems
SSDBM International Conference on Scientific and Statistical Data Base Management
STACS International Symposium on Theoretical Aspects of Computer Science
STOC ACM Symposium on Theory of Computing
Supercomputing The International Conference for High Performance Computing and Networking, Storage and Analysis
TCC Theory of Cryptography Conference
TOPLAS ACM Transactions on Programming Languages and Systems
TPHOLs International Conference on Theorem Proving in Higher Order Logics (will be ITP from 2010)
UAI Conference on Uncertainty in Artificial Intelligence
UBICOMP Ubiquitous Computing
UIST ACM Symposium on User Interface Software and Technology
USENIX ATC USENIX Annual Technical Conference
USENIX FAST Conference on File and Storage Technologies
USENIX NSDI Symposium on Networked Systems Design and Implementation
USENIX Security USENIX Security Symposium
VEE International Conference on Virtual Execution Environments
VIS IEEE Visualization Conference
VL/HCC IEEE Symposium on Visual Languages and Human-Centric Computing
VLDB International conference on Very large data bases
VLSI Symposia on VLSI Technology and Circuits
WADS Algorithms and Data Structures Symposium (was Workshop on Algorithms and Data Structures)
WCCI World Congress on Computational Intelligence
WiMOB IEEE International Conference on Wireless and Mobile Computing, Networking and Communications
WoWMoM IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks
WSDM ACM International Conference on Web Search and Data Mining
WWW International World Wide Web Conference